2023-09-19 00:01:10,266 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-19 00:01:10,467 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e 2023-09-19 00:01:10,468 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-19 00:01:10,468 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-19 00:01:10,507 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-19 00:01:10,753 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-19 00:01:10,754 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44, deleteOnExit=true 2023-09-19 00:01:10,754 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-19 00:01:10,754 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/test.cache.data in system properties and HBase conf 2023-09-19 00:01:10,755 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop.tmp.dir in system properties and HBase conf 2023-09-19 00:01:10,755 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop.log.dir in system properties and HBase conf 2023-09-19 00:01:10,756 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-19 00:01:10,756 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-19 00:01:10,756 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-19 00:01:11,078 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-19 00:01:11,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-19 00:01:11,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-19 00:01:11,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-19 00:01:11,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 00:01:11,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-19 00:01:11,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-19 00:01:11,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 00:01:11,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 00:01:11,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-19 00:01:11,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/nfs.dump.dir in system properties and HBase conf 2023-09-19 00:01:11,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir in system properties and HBase conf 2023-09-19 00:01:11,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 00:01:11,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-19 00:01:11,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-19 00:01:11,623 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-19 00:01:11,629 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-19 00:01:11,948 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-19 00:01:12,112 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-19 00:01:12,125 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:12,164 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:12,199 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_localhost_38635_hdfs____d37ebh/webapp 2023-09-19 00:01:12,346 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38635 2023-09-19 00:01:12,357 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-19 00:01:12,357 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-19 00:01:12,860 WARN [Listener at localhost/36399] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 00:01:12,936 WARN [Listener at localhost/36399] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 00:01:12,957 WARN [Listener at localhost/36399] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:13,020 INFO [Listener at localhost/36399] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:13,026 INFO [Listener at localhost/36399] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_localhost_36607_datanode____.fb0g4f/webapp 2023-09-19 00:01:13,126 INFO [Listener at localhost/36399] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36607 2023-09-19 00:01:13,566 WARN [Listener at localhost/36179] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 00:01:13,579 WARN [Listener at localhost/36179] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 00:01:13,583 WARN [Listener at localhost/36179] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:13,585 INFO [Listener at localhost/36179] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:13,594 INFO [Listener at localhost/36179] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_localhost_41795_datanode____8ogqu5/webapp 2023-09-19 00:01:13,701 INFO [Listener at localhost/36179] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41795 2023-09-19 00:01:13,713 WARN [Listener at localhost/35791] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 00:01:13,731 WARN [Listener at localhost/35791] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 00:01:13,735 WARN [Listener at localhost/35791] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:13,737 INFO [Listener at localhost/35791] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:13,743 INFO [Listener at localhost/35791] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_localhost_37613_datanode____.cp89id/webapp 2023-09-19 00:01:13,859 INFO [Listener at localhost/35791] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37613 2023-09-19 00:01:13,873 WARN [Listener at localhost/37725] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 00:01:14,206 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc0f155b24fceffc3: Processing first storage report for DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a from datanode e32d1ce4-9fc2-4c73-9e78-a0c2e66c5480 2023-09-19 00:01:14,208 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc0f155b24fceffc3: from storage DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a node DatanodeRegistration(127.0.0.1:38727, datanodeUuid=e32d1ce4-9fc2-4c73-9e78-a0c2e66c5480, infoPort=45165, infoSecurePort=0, ipcPort=35791, storageInfo=lv=-57;cid=testClusterID;nsid=49107849;c=1695081671717), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-19 00:01:14,208 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16d8ef6f099cd333: Processing first storage report for DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a from datanode 1114d34d-79a5-4ccd-be42-f7b88d129a86 2023-09-19 00:01:14,208 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16d8ef6f099cd333: from storage DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a node DatanodeRegistration(127.0.0.1:41591, datanodeUuid=1114d34d-79a5-4ccd-be42-f7b88d129a86, infoPort=42245, infoSecurePort=0, ipcPort=37725, storageInfo=lv=-57;cid=testClusterID;nsid=49107849;c=1695081671717), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11e6205810c80c75: Processing first storage report for DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f from datanode 09ebf97c-6f57-4c31-b940-e8c7ca284544 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11e6205810c80c75: from storage DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f node DatanodeRegistration(127.0.0.1:36959, datanodeUuid=09ebf97c-6f57-4c31-b940-e8c7ca284544, infoPort=43177, infoSecurePort=0, ipcPort=36179, storageInfo=lv=-57;cid=testClusterID;nsid=49107849;c=1695081671717), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc0f155b24fceffc3: Processing first storage report for DS-725f1703-e115-4528-acb8-691fabeb9fb3 from datanode e32d1ce4-9fc2-4c73-9e78-a0c2e66c5480 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc0f155b24fceffc3: from storage DS-725f1703-e115-4528-acb8-691fabeb9fb3 node DatanodeRegistration(127.0.0.1:38727, datanodeUuid=e32d1ce4-9fc2-4c73-9e78-a0c2e66c5480, infoPort=45165, infoSecurePort=0, ipcPort=35791, storageInfo=lv=-57;cid=testClusterID;nsid=49107849;c=1695081671717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16d8ef6f099cd333: Processing first storage report for DS-0a7eea2d-8793-4b2d-b8df-7b5584ba91a7 from datanode 1114d34d-79a5-4ccd-be42-f7b88d129a86 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16d8ef6f099cd333: from storage DS-0a7eea2d-8793-4b2d-b8df-7b5584ba91a7 node DatanodeRegistration(127.0.0.1:41591, datanodeUuid=1114d34d-79a5-4ccd-be42-f7b88d129a86, infoPort=42245, infoSecurePort=0, ipcPort=37725, storageInfo=lv=-57;cid=testClusterID;nsid=49107849;c=1695081671717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11e6205810c80c75: Processing first storage report for DS-5041924d-4d9e-4a19-b99e-c6a786300f03 from datanode 09ebf97c-6f57-4c31-b940-e8c7ca284544 2023-09-19 00:01:14,209 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11e6205810c80c75: from storage DS-5041924d-4d9e-4a19-b99e-c6a786300f03 node DatanodeRegistration(127.0.0.1:36959, datanodeUuid=09ebf97c-6f57-4c31-b940-e8c7ca284544, infoPort=43177, infoSecurePort=0, ipcPort=36179, storageInfo=lv=-57;cid=testClusterID;nsid=49107849;c=1695081671717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 00:01:14,366 DEBUG [Listener at localhost/37725] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e 2023-09-19 00:01:14,469 INFO [Listener at localhost/37725] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/zookeeper_0, clientPort=62806, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-19 00:01:14,490 INFO [Listener at localhost/37725] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62806 2023-09-19 00:01:14,502 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:14,505 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:15,203 INFO [Listener at localhost/37725] util.FSUtils(471): Created version file at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a with version=8 2023-09-19 00:01:15,203 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/hbase-staging 2023-09-19 00:01:15,673 INFO [Listener at localhost/37725] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-19 00:01:16,170 INFO [Listener at localhost/37725] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 00:01:16,203 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,203 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,204 INFO [Listener at localhost/37725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 00:01:16,204 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,204 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 00:01:16,349 INFO [Listener at localhost/37725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 00:01:16,425 DEBUG [Listener at localhost/37725] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-19 00:01:16,522 INFO [Listener at localhost/37725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45153 2023-09-19 00:01:16,535 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,538 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,562 INFO [Listener at localhost/37725] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45153 connecting to ZooKeeper ensemble=127.0.0.1:62806 2023-09-19 00:01:16,621 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:451530x0, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 00:01:16,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45153-0x100c17cee750000 connected 2023-09-19 00:01:16,664 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 00:01:16,664 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:01:16,681 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 00:01:16,692 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45153 2023-09-19 00:01:16,692 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45153 2023-09-19 00:01:16,693 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45153 2023-09-19 00:01:16,694 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45153 2023-09-19 00:01:16,697 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45153 2023-09-19 00:01:16,703 INFO [Listener at localhost/37725] master.HMaster(444): hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, hbase.cluster.distributed=false 2023-09-19 00:01:16,765 INFO [Listener at localhost/37725] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 00:01:16,766 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,766 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,766 INFO [Listener at localhost/37725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 00:01:16,766 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,766 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 00:01:16,771 INFO [Listener at localhost/37725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 00:01:16,774 INFO [Listener at localhost/37725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35543 2023-09-19 00:01:16,776 INFO [Listener at localhost/37725] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 00:01:16,783 INFO [Listener at localhost/37725] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 00:01:16,784 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,786 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,788 INFO [Listener at localhost/37725] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35543 connecting to ZooKeeper ensemble=127.0.0.1:62806 2023-09-19 00:01:16,792 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:355430x0, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 00:01:16,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35543-0x100c17cee750001 connected 2023-09-19 00:01:16,794 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 00:01:16,795 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:01:16,796 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 00:01:16,797 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35543 2023-09-19 00:01:16,797 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35543 2023-09-19 00:01:16,798 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35543 2023-09-19 00:01:16,804 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35543 2023-09-19 00:01:16,804 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35543 2023-09-19 00:01:16,817 INFO [Listener at localhost/37725] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 00:01:16,817 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,817 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,818 INFO [Listener at localhost/37725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 00:01:16,818 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,819 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 00:01:16,819 INFO [Listener at localhost/37725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 00:01:16,821 INFO [Listener at localhost/37725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39367 2023-09-19 00:01:16,821 INFO [Listener at localhost/37725] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 00:01:16,822 INFO [Listener at localhost/37725] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 00:01:16,823 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,826 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,830 INFO [Listener at localhost/37725] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39367 connecting to ZooKeeper ensemble=127.0.0.1:62806 2023-09-19 00:01:16,833 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:393670x0, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 00:01:16,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39367-0x100c17cee750002 connected 2023-09-19 00:01:16,835 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 00:01:16,836 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:01:16,836 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 00:01:16,837 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39367 2023-09-19 00:01:16,837 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39367 2023-09-19 00:01:16,837 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39367 2023-09-19 00:01:16,838 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39367 2023-09-19 00:01:16,838 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39367 2023-09-19 00:01:16,850 INFO [Listener at localhost/37725] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 00:01:16,850 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,850 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,851 INFO [Listener at localhost/37725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 00:01:16,851 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 00:01:16,851 INFO [Listener at localhost/37725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 00:01:16,851 INFO [Listener at localhost/37725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 00:01:16,852 INFO [Listener at localhost/37725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34277 2023-09-19 00:01:16,853 INFO [Listener at localhost/37725] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 00:01:16,857 INFO [Listener at localhost/37725] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 00:01:16,858 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,860 INFO [Listener at localhost/37725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:16,862 INFO [Listener at localhost/37725] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34277 connecting to ZooKeeper ensemble=127.0.0.1:62806 2023-09-19 00:01:16,866 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:342770x0, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 00:01:16,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34277-0x100c17cee750003 connected 2023-09-19 00:01:16,867 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 00:01:16,868 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:01:16,869 DEBUG [Listener at localhost/37725] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 00:01:16,872 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34277 2023-09-19 00:01:16,873 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34277 2023-09-19 00:01:16,873 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34277 2023-09-19 00:01:16,873 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34277 2023-09-19 00:01:16,874 DEBUG [Listener at localhost/37725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34277 2023-09-19 00:01:16,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:16,887 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-19 00:01:16,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:16,907 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 00:01:16,907 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 00:01:16,907 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 00:01:16,907 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 00:01:16,907 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:16,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-19 00:01:16,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45153,1695081675422 from backup master directory 2023-09-19 00:01:16,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-19 00:01:16,915 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:16,916 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-19 00:01:16,916 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 00:01:16,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:16,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-19 00:01:16,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-19 00:01:17,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/hbase.id with ID: 930603af-9e93-4bf7-b5c4-9f4ad861ebe0 2023-09-19 00:01:17,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 00:01:17,079 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:17,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2a2539bf to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:17,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@118347ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:17,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-19 00:01:17,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-19 00:01:17,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-19 00:01:17,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-19 00:01:17,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-19 00:01:17,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-19 00:01:17,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 00:01:17,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store-tmp 2023-09-19 00:01:17,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:17,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-19 00:01:17,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:01:17,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:01:17,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-19 00:01:17,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:01:17,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:01:17,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 00:01:17,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/WALs/jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:17,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45153%2C1695081675422, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/WALs/jenkins-hbase4.apache.org,45153,1695081675422, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/oldWALs, maxLogs=10 2023-09-19 00:01:17,372 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK] 2023-09-19 00:01:17,372 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK] 2023-09-19 00:01:17,372 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK] 2023-09-19 00:01:17,381 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-19 00:01:17,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/WALs/jenkins-hbase4.apache.org,45153,1695081675422/jenkins-hbase4.apache.org%2C45153%2C1695081675422.1695081677327 2023-09-19 00:01:17,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK], DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK], DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK]] 2023-09-19 00:01:17,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-19 00:01:17,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:17,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 00:01:17,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 00:01:17,527 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-19 00:01:17,534 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-19 00:01:17,562 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-19 00:01:17,575 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:17,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-19 00:01:17,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-19 00:01:17,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 00:01:17,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:17,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60819490, jitterRate=-0.09371897578239441}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:01:17,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 00:01:17,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-19 00:01:17,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-19 00:01:17,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-19 00:01:17,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-19 00:01:17,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-19 00:01:17,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 47 msec 2023-09-19 00:01:17,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-19 00:01:17,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-19 00:01:17,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-19 00:01:17,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-19 00:01:17,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-19 00:01:17,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-19 00:01:17,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-19 00:01:17,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-19 00:01:17,772 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:17,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-19 00:01:17,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-19 00:01:17,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-19 00:01:17,792 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 00:01:17,792 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 00:01:17,792 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 00:01:17,793 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:17,792 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 00:01:17,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45153,1695081675422, sessionid=0x100c17cee750000, setting cluster-up flag (Was=false) 2023-09-19 00:01:17,815 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:17,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-19 00:01:17,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:17,829 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:17,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-19 00:01:17,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:17,841 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp 2023-09-19 00:01:17,880 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(951): ClusterId : 930603af-9e93-4bf7-b5c4-9f4ad861ebe0 2023-09-19 00:01:17,880 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(951): ClusterId : 930603af-9e93-4bf7-b5c4-9f4ad861ebe0 2023-09-19 00:01:17,880 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(951): ClusterId : 930603af-9e93-4bf7-b5c4-9f4ad861ebe0 2023-09-19 00:01:17,886 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 00:01:17,886 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 00:01:17,886 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 00:01:17,899 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 00:01:17,899 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 00:01:17,899 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 00:01:17,899 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 00:01:17,901 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 00:01:17,901 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 00:01:17,905 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 00:01:17,906 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 00:01:17,908 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 00:01:17,910 DEBUG [RS:0;jenkins-hbase4:35543] zookeeper.ReadOnlyZKClient(139): Connect 0x2c233932 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:17,911 DEBUG [RS:2;jenkins-hbase4:34277] zookeeper.ReadOnlyZKClient(139): Connect 0x58778c48 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:17,912 DEBUG [RS:1;jenkins-hbase4:39367] zookeeper.ReadOnlyZKClient(139): Connect 0x72c805b5 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:17,933 DEBUG [RS:0;jenkins-hbase4:35543] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22e4c2c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:17,934 DEBUG [RS:0;jenkins-hbase4:35543] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26db5242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 00:01:17,936 DEBUG [RS:2;jenkins-hbase4:34277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b07936, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:17,937 DEBUG [RS:2;jenkins-hbase4:34277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@528fe738, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 00:01:17,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-19 00:01:17,965 DEBUG [RS:1;jenkins-hbase4:39367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c0fe59c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:17,965 DEBUG [RS:1;jenkins-hbase4:39367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78306ec5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 00:01:17,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:17,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-19 00:01:17,995 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34277 2023-09-19 00:01:17,995 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35543 2023-09-19 00:01:17,998 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39367 2023-09-19 00:01:18,002 INFO [RS:2;jenkins-hbase4:34277] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 00:01:18,011 INFO [RS:0;jenkins-hbase4:35543] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 00:01:18,011 INFO [RS:0;jenkins-hbase4:35543] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 00:01:18,002 INFO [RS:1;jenkins-hbase4:39367] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 00:01:18,011 INFO [RS:1;jenkins-hbase4:39367] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 00:01:18,012 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 00:01:18,011 INFO [RS:2;jenkins-hbase4:34277] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 00:01:18,012 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 00:01:18,014 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 00:01:18,014 INFO [RS:0;jenkins-hbase4:35543] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:18,014 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 00:01:18,013 INFO [RS:1;jenkins-hbase4:39367] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:18,014 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 00:01:18,014 INFO [RS:2;jenkins-hbase4:34277] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:18,015 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 00:01:18,019 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45153,1695081675422 with isa=jenkins-hbase4.apache.org/172.31.14.131:39367, startcode=1695081676816 2023-09-19 00:01:18,019 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45153,1695081675422 with isa=jenkins-hbase4.apache.org/172.31.14.131:35543, startcode=1695081676765 2023-09-19 00:01:18,020 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45153,1695081675422 with isa=jenkins-hbase4.apache.org/172.31.14.131:34277, startcode=1695081676849 2023-09-19 00:01:18,041 DEBUG [RS:1;jenkins-hbase4:39367] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 00:01:18,041 DEBUG [RS:0;jenkins-hbase4:35543] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 00:01:18,041 DEBUG [RS:2;jenkins-hbase4:34277] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 00:01:18,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-19 00:01:18,098 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49739, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 00:01:18,098 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44457, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 00:01:18,098 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41821, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 00:01:18,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 00:01:18,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 00:01:18,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 00:01:18,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 00:01:18,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-19 00:01:18,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 00:01:18,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695081708103 2023-09-19 00:01:18,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-19 00:01:18,109 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45153] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 00:01:18,118 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-19 00:01:18,118 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45153] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 00:01:18,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-19 00:01:18,119 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45153] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 00:01:18,119 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-19 00:01:18,127 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 00:01:18,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-19 00:01:18,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-19 00:01:18,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-19 00:01:18,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-19 00:01:18,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-19 00:01:18,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-19 00:01:18,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-19 00:01:18,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-19 00:01:18,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-19 00:01:18,144 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 00:01:18,144 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 00:01:18,145 WARN [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 00:01:18,144 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 00:01:18,145 WARN [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 00:01:18,145 WARN [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 00:01:18,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695081678145,5,FailOnTimeoutGroup] 2023-09-19 00:01:18,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695081678145,5,FailOnTimeoutGroup] 2023-09-19 00:01:18,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-19 00:01:18,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,174 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-19 00:01:18,175 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-19 00:01:18,176 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:18,203 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:18,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-19 00:01:18,209 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/info 2023-09-19 00:01:18,210 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-19 00:01:18,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:18,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-19 00:01:18,214 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/rep_barrier 2023-09-19 00:01:18,215 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-19 00:01:18,216 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:18,216 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-19 00:01:18,218 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/table 2023-09-19 00:01:18,218 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-19 00:01:18,219 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:18,221 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740 2023-09-19 00:01:18,222 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740 2023-09-19 00:01:18,226 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-19 00:01:18,228 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-19 00:01:18,232 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:18,232 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59543767, jitterRate=-0.11272872984409332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-19 00:01:18,232 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-19 00:01:18,233 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-19 00:01:18,233 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-19 00:01:18,233 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-19 00:01:18,233 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-19 00:01:18,233 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-19 00:01:18,235 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-19 00:01:18,235 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-19 00:01:18,241 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-19 00:01:18,241 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-19 00:01:18,246 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45153,1695081675422 with isa=jenkins-hbase4.apache.org/172.31.14.131:34277, startcode=1695081676849 2023-09-19 00:01:18,247 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45153,1695081675422 with isa=jenkins-hbase4.apache.org/172.31.14.131:35543, startcode=1695081676765 2023-09-19 00:01:18,247 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45153,1695081675422 with isa=jenkins-hbase4.apache.org/172.31.14.131:39367, startcode=1695081676816 2023-09-19 00:01:18,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-19 00:01:18,253 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45153] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,258 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45153] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,260 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45153] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,260 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:18,260 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36399 2023-09-19 00:01:18,260 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 00:01:18,262 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:18,262 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36399 2023-09-19 00:01:18,262 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:18,262 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 00:01:18,262 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36399 2023-09-19 00:01:18,262 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 00:01:18,272 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 00:01:18,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-19 00:01:18,273 DEBUG [RS:1;jenkins-hbase4:39367] zookeeper.ZKUtil(162): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,273 WARN [RS:1;jenkins-hbase4:39367] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 00:01:18,273 INFO [RS:1;jenkins-hbase4:39367] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 00:01:18,273 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,273 DEBUG [RS:0;jenkins-hbase4:35543] zookeeper.ZKUtil(162): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,273 DEBUG [RS:2;jenkins-hbase4:34277] zookeeper.ZKUtil(162): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,274 WARN [RS:0;jenkins-hbase4:35543] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 00:01:18,275 WARN [RS:2;jenkins-hbase4:34277] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 00:01:18,278 INFO [RS:0;jenkins-hbase4:35543] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 00:01:18,278 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,278 INFO [RS:2;jenkins-hbase4:34277] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 00:01:18,279 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,279 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-19 00:01:18,283 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35543,1695081676765] 2023-09-19 00:01:18,283 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34277,1695081676849] 2023-09-19 00:01:18,283 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39367,1695081676816] 2023-09-19 00:01:18,292 DEBUG [RS:1;jenkins-hbase4:39367] zookeeper.ZKUtil(162): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,292 DEBUG [RS:0;jenkins-hbase4:35543] zookeeper.ZKUtil(162): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,292 DEBUG [RS:2;jenkins-hbase4:34277] zookeeper.ZKUtil(162): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,293 DEBUG [RS:1;jenkins-hbase4:39367] zookeeper.ZKUtil(162): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,293 DEBUG [RS:0;jenkins-hbase4:35543] zookeeper.ZKUtil(162): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,293 DEBUG [RS:2;jenkins-hbase4:34277] zookeeper.ZKUtil(162): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,293 DEBUG [RS:1;jenkins-hbase4:39367] zookeeper.ZKUtil(162): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,294 DEBUG [RS:0;jenkins-hbase4:35543] zookeeper.ZKUtil(162): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,294 DEBUG [RS:2;jenkins-hbase4:34277] zookeeper.ZKUtil(162): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,307 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 00:01:18,307 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 00:01:18,307 DEBUG [RS:2;jenkins-hbase4:34277] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 00:01:18,318 INFO [RS:2;jenkins-hbase4:34277] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 00:01:18,318 INFO [RS:0;jenkins-hbase4:35543] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 00:01:18,318 INFO [RS:1;jenkins-hbase4:39367] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 00:01:18,343 INFO [RS:2;jenkins-hbase4:34277] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 00:01:18,343 INFO [RS:0;jenkins-hbase4:35543] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 00:01:18,343 INFO [RS:1;jenkins-hbase4:39367] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 00:01:18,347 INFO [RS:2;jenkins-hbase4:34277] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 00:01:18,347 INFO [RS:1;jenkins-hbase4:39367] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 00:01:18,348 INFO [RS:2;jenkins-hbase4:34277] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,347 INFO [RS:0;jenkins-hbase4:35543] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 00:01:18,348 INFO [RS:1;jenkins-hbase4:39367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,348 INFO [RS:0;jenkins-hbase4:35543] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,349 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 00:01:18,349 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 00:01:18,350 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 00:01:18,358 INFO [RS:2;jenkins-hbase4:34277] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,358 INFO [RS:0;jenkins-hbase4:35543] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,358 INFO [RS:1;jenkins-hbase4:39367] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,358 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,358 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 00:01:18,359 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,360 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,359 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,360 DEBUG [RS:2;jenkins-hbase4:34277] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,360 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,360 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,360 DEBUG [RS:1;jenkins-hbase4:39367] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,360 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,360 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 00:01:18,361 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,361 INFO [RS:2;jenkins-hbase4:34277] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,361 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,361 INFO [RS:2;jenkins-hbase4:34277] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,361 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,361 INFO [RS:2;jenkins-hbase4:34277] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,362 DEBUG [RS:0;jenkins-hbase4:35543] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 00:01:18,364 INFO [RS:1;jenkins-hbase4:39367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,364 INFO [RS:1;jenkins-hbase4:39367] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,364 INFO [RS:1;jenkins-hbase4:39367] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,365 INFO [RS:0;jenkins-hbase4:35543] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,365 INFO [RS:0;jenkins-hbase4:35543] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,365 INFO [RS:0;jenkins-hbase4:35543] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,382 INFO [RS:0;jenkins-hbase4:35543] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 00:01:18,382 INFO [RS:2;jenkins-hbase4:34277] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 00:01:18,382 INFO [RS:1;jenkins-hbase4:39367] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 00:01:18,386 INFO [RS:1;jenkins-hbase4:39367] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39367,1695081676816-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,386 INFO [RS:0;jenkins-hbase4:35543] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35543,1695081676765-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,386 INFO [RS:2;jenkins-hbase4:34277] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34277,1695081676849-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:18,407 INFO [RS:2;jenkins-hbase4:34277] regionserver.Replication(203): jenkins-hbase4.apache.org,34277,1695081676849 started 2023-09-19 00:01:18,407 INFO [RS:1;jenkins-hbase4:39367] regionserver.Replication(203): jenkins-hbase4.apache.org,39367,1695081676816 started 2023-09-19 00:01:18,407 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34277,1695081676849, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34277, sessionid=0x100c17cee750003 2023-09-19 00:01:18,408 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39367,1695081676816, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39367, sessionid=0x100c17cee750002 2023-09-19 00:01:18,408 INFO [RS:0;jenkins-hbase4:35543] regionserver.Replication(203): jenkins-hbase4.apache.org,35543,1695081676765 started 2023-09-19 00:01:18,408 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 00:01:18,408 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 00:01:18,408 DEBUG [RS:1;jenkins-hbase4:39367] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,408 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35543,1695081676765, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35543, sessionid=0x100c17cee750001 2023-09-19 00:01:18,409 DEBUG [RS:1;jenkins-hbase4:39367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39367,1695081676816' 2023-09-19 00:01:18,409 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 00:01:18,410 DEBUG [RS:0;jenkins-hbase4:35543] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,408 DEBUG [RS:2;jenkins-hbase4:34277] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,410 DEBUG [RS:0;jenkins-hbase4:35543] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35543,1695081676765' 2023-09-19 00:01:18,410 DEBUG [RS:0;jenkins-hbase4:35543] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 00:01:18,409 DEBUG [RS:1;jenkins-hbase4:39367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 00:01:18,410 DEBUG [RS:2;jenkins-hbase4:34277] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34277,1695081676849' 2023-09-19 00:01:18,411 DEBUG [RS:2;jenkins-hbase4:34277] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 00:01:18,411 DEBUG [RS:0;jenkins-hbase4:35543] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 00:01:18,412 DEBUG [RS:2;jenkins-hbase4:34277] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 00:01:18,411 DEBUG [RS:1;jenkins-hbase4:39367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 00:01:18,412 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 00:01:18,412 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 00:01:18,412 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 00:01:18,412 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 00:01:18,413 DEBUG [RS:1;jenkins-hbase4:39367] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,412 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 00:01:18,413 DEBUG [RS:1;jenkins-hbase4:39367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39367,1695081676816' 2023-09-19 00:01:18,413 DEBUG [RS:1;jenkins-hbase4:39367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:18,413 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 00:01:18,413 DEBUG [RS:0;jenkins-hbase4:35543] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:18,414 DEBUG [RS:0;jenkins-hbase4:35543] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35543,1695081676765' 2023-09-19 00:01:18,414 DEBUG [RS:0;jenkins-hbase4:35543] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:18,413 DEBUG [RS:2;jenkins-hbase4:34277] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:18,414 DEBUG [RS:1;jenkins-hbase4:39367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:18,414 DEBUG [RS:2;jenkins-hbase4:34277] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34277,1695081676849' 2023-09-19 00:01:18,414 DEBUG [RS:2;jenkins-hbase4:34277] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:18,414 DEBUG [RS:0;jenkins-hbase4:35543] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:18,414 DEBUG [RS:1;jenkins-hbase4:39367] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 00:01:18,415 INFO [RS:1;jenkins-hbase4:39367] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 00:01:18,415 INFO [RS:1;jenkins-hbase4:39367] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 00:01:18,415 DEBUG [RS:0;jenkins-hbase4:35543] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 00:01:18,415 DEBUG [RS:2;jenkins-hbase4:34277] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:18,415 INFO [RS:0;jenkins-hbase4:35543] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 00:01:18,415 INFO [RS:0;jenkins-hbase4:35543] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 00:01:18,417 DEBUG [RS:2;jenkins-hbase4:34277] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 00:01:18,417 INFO [RS:2;jenkins-hbase4:34277] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 00:01:18,417 INFO [RS:2;jenkins-hbase4:34277] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 00:01:18,432 DEBUG [jenkins-hbase4:45153] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-19 00:01:18,437 DEBUG [jenkins-hbase4:45153] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:01:18,443 DEBUG [jenkins-hbase4:45153] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:01:18,443 DEBUG [jenkins-hbase4:45153] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:01:18,443 DEBUG [jenkins-hbase4:45153] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:01:18,444 DEBUG [jenkins-hbase4:45153] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:01:18,447 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39367,1695081676816, state=OPENING 2023-09-19 00:01:18,457 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-19 00:01:18,459 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:18,459 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-19 00:01:18,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:01:18,526 INFO [RS:0;jenkins-hbase4:35543] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35543%2C1695081676765, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,35543,1695081676765, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs, maxLogs=32 2023-09-19 00:01:18,526 INFO [RS:1;jenkins-hbase4:39367] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39367%2C1695081676816, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,39367,1695081676816, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs, maxLogs=32 2023-09-19 00:01:18,526 INFO [RS:2;jenkins-hbase4:34277] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34277%2C1695081676849, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,34277,1695081676849, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs, maxLogs=32 2023-09-19 00:01:18,550 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK] 2023-09-19 00:01:18,551 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK] 2023-09-19 00:01:18,551 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK] 2023-09-19 00:01:18,565 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK] 2023-09-19 00:01:18,565 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK] 2023-09-19 00:01:18,565 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK] 2023-09-19 00:01:18,566 INFO [RS:2;jenkins-hbase4:34277] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,34277,1695081676849/jenkins-hbase4.apache.org%2C34277%2C1695081676849.1695081678531 2023-09-19 00:01:18,569 DEBUG [RS:2;jenkins-hbase4:34277] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK], DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK], DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK]] 2023-09-19 00:01:18,570 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK] 2023-09-19 00:01:18,570 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK] 2023-09-19 00:01:18,570 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK] 2023-09-19 00:01:18,580 INFO [RS:1;jenkins-hbase4:39367] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,39367,1695081676816/jenkins-hbase4.apache.org%2C39367%2C1695081676816.1695081678531 2023-09-19 00:01:18,581 DEBUG [RS:1;jenkins-hbase4:39367] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK], DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK], DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK]] 2023-09-19 00:01:18,582 INFO [RS:0;jenkins-hbase4:35543] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,35543,1695081676765/jenkins-hbase4.apache.org%2C35543%2C1695081676765.1695081678531 2023-09-19 00:01:18,585 DEBUG [RS:0;jenkins-hbase4:35543] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK], DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK], DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK]] 2023-09-19 00:01:18,648 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:18,651 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 00:01:18,654 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 00:01:18,670 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-19 00:01:18,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 00:01:18,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39367%2C1695081676816.meta, suffix=.meta, logDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,39367,1695081676816, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs, maxLogs=32 2023-09-19 00:01:18,692 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK] 2023-09-19 00:01:18,693 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK] 2023-09-19 00:01:18,694 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK] 2023-09-19 00:01:18,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/WALs/jenkins-hbase4.apache.org,39367,1695081676816/jenkins-hbase4.apache.org%2C39367%2C1695081676816.meta.1695081678675.meta 2023-09-19 00:01:18,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41591,DS-ec8ec897-3f14-40ea-a194-29bfef5cc29a,DISK], DatanodeInfoWithStorage[127.0.0.1:36959,DS-d644485c-4c12-40df-8bb0-f66ac49b0a6f,DISK], DatanodeInfoWithStorage[127.0.0.1:38727,DS-1097afc7-2e0e-4d7f-9d1f-f882ab4e8c3a,DISK]] 2023-09-19 00:01:18,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-19 00:01:18,708 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-19 00:01:18,709 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:18,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-19 00:01:18,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-19 00:01:18,713 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-19 00:01:18,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-19 00:01:18,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:18,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-19 00:01:18,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-19 00:01:18,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-19 00:01:18,731 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/info 2023-09-19 00:01:18,731 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/info 2023-09-19 00:01:18,732 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-19 00:01:18,733 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:18,733 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-19 00:01:18,734 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/rep_barrier 2023-09-19 00:01:18,734 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/rep_barrier 2023-09-19 00:01:18,735 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-19 00:01:18,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:18,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-19 00:01:18,737 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/table 2023-09-19 00:01:18,737 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/table 2023-09-19 00:01:18,738 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-19 00:01:18,738 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:18,740 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740 2023-09-19 00:01:18,743 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740 2023-09-19 00:01:18,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-19 00:01:18,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-19 00:01:18,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65691733, jitterRate=-0.021116897463798523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-19 00:01:18,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-19 00:01:18,762 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695081678641 2023-09-19 00:01:18,780 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-19 00:01:18,781 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-19 00:01:18,781 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39367,1695081676816, state=OPEN 2023-09-19 00:01:18,784 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-19 00:01:18,784 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-19 00:01:18,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-19 00:01:18,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39367,1695081676816 in 321 msec 2023-09-19 00:01:18,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-19 00:01:18,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 539 msec 2023-09-19 00:01:18,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 824 msec 2023-09-19 00:01:18,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695081678801, completionTime=-1 2023-09-19 00:01:18,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-19 00:01:18,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-19 00:01:18,883 DEBUG [hconnection-0x6c025f5e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:18,887 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:18,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-19 00:01:18,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695081738924 2023-09-19 00:01:18,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695081798924 2023-09-19 00:01:18,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 123 msec 2023-09-19 00:01:19,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45153,1695081675422-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:19,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45153,1695081675422-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:19,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45153,1695081675422-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:19,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45153, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:19,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-19 00:01:19,048 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-19 00:01:19,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-19 00:01:19,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 00:01:19,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-19 00:01:19,070 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:01:19,073 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:01:19,096 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,099 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd empty. 2023-09-19 00:01:19,100 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,100 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-19 00:01:19,145 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-19 00:01:19,147 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c7a1e9d93d6eb9dc2d446972efd4d1bd, NAME => 'hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:19,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:19,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c7a1e9d93d6eb9dc2d446972efd4d1bd, disabling compactions & flushes 2023-09-19 00:01:19,170 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:01:19,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:01:19,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. after waiting 0 ms 2023-09-19 00:01:19,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:01:19,170 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:01:19,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c7a1e9d93d6eb9dc2d446972efd4d1bd: 2023-09-19 00:01:19,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:01:19,191 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695081679179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081679179"}]},"ts":"1695081679179"} 2023-09-19 00:01:19,219 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-19 00:01:19,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:01:19,226 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081679222"}]},"ts":"1695081679222"} 2023-09-19 00:01:19,231 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-19 00:01:19,235 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:01:19,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:01:19,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:01:19,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:01:19,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:01:19,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7a1e9d93d6eb9dc2d446972efd4d1bd, ASSIGN}] 2023-09-19 00:01:19,242 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7a1e9d93d6eb9dc2d446972efd4d1bd, ASSIGN 2023-09-19 00:01:19,244 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c7a1e9d93d6eb9dc2d446972efd4d1bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35543,1695081676765; forceNewPlan=false, retain=false 2023-09-19 00:01:19,396 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 00:01:19,397 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7a1e9d93d6eb9dc2d446972efd4d1bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:19,398 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695081679397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081679397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081679397"}]},"ts":"1695081679397"} 2023-09-19 00:01:19,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c7a1e9d93d6eb9dc2d446972efd4d1bd, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:01:19,559 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:19,559 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 00:01:19,562 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 00:01:19,569 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:01:19,569 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7a1e9d93d6eb9dc2d446972efd4d1bd, NAME => 'hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.', STARTKEY => '', ENDKEY => ''} 2023-09-19 00:01:19,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. service=AccessControlService 2023-09-19 00:01:19,570 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:19,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:19,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,574 INFO [StoreOpener-c7a1e9d93d6eb9dc2d446972efd4d1bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,576 DEBUG [StoreOpener-c7a1e9d93d6eb9dc2d446972efd4d1bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/info 2023-09-19 00:01:19,576 DEBUG [StoreOpener-c7a1e9d93d6eb9dc2d446972efd4d1bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/info 2023-09-19 00:01:19,577 INFO [StoreOpener-c7a1e9d93d6eb9dc2d446972efd4d1bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a1e9d93d6eb9dc2d446972efd4d1bd columnFamilyName info 2023-09-19 00:01:19,577 INFO [StoreOpener-c7a1e9d93d6eb9dc2d446972efd4d1bd-1] regionserver.HStore(310): Store=c7a1e9d93d6eb9dc2d446972efd4d1bd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:19,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:01:19,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:19,588 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7a1e9d93d6eb9dc2d446972efd4d1bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59613811, jitterRate=-0.11168499290943146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:01:19,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7a1e9d93d6eb9dc2d446972efd4d1bd: 2023-09-19 00:01:19,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd., pid=6, masterSystemTime=1695081679559 2023-09-19 00:01:19,595 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:01:19,595 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:01:19,597 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7a1e9d93d6eb9dc2d446972efd4d1bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:19,597 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695081679596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081679596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081679596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081679596"}]},"ts":"1695081679596"} 2023-09-19 00:01:19,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-19 00:01:19,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c7a1e9d93d6eb9dc2d446972efd4d1bd, server=jenkins-hbase4.apache.org,35543,1695081676765 in 197 msec 2023-09-19 00:01:19,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-19 00:01:19,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c7a1e9d93d6eb9dc2d446972efd4d1bd, ASSIGN in 367 msec 2023-09-19 00:01:19,611 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:01:19,611 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081679611"}]},"ts":"1695081679611"} 2023-09-19 00:01:19,613 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-19 00:01:19,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:01:19,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 559 msec 2023-09-19 00:01:19,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-19 00:01:19,672 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-19 00:01:19,672 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:19,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:19,698 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:19,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-19 00:01:19,736 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-19 00:01:19,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-09-19 00:01:19,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-19 00:01:19,762 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-19 00:01:19,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-19 00:01:19,776 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-19 00:01:19,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-19 00:01:19,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.864sec 2023-09-19 00:01:19,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-19 00:01:19,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-19 00:01:19,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-19 00:01:19,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45153,1695081675422-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-19 00:01:19,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45153,1695081675422-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-19 00:01:19,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 00:01:19,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-19 00:01:19,814 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:01:19,815 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:01:19,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-19 00:01:19,818 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:19,819 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4 empty. 2023-09-19 00:01:19,822 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:19,822 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-19 00:01:19,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 00:01:19,846 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-19 00:01:19,847 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 779c17ce2e69dff7c9a8d5348ef6f6d4, NAME => 'hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:19,872 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:19,872 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 779c17ce2e69dff7c9a8d5348ef6f6d4, disabling compactions & flushes 2023-09-19 00:01:19,872 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:01:19,872 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:01:19,872 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. after waiting 0 ms 2023-09-19 00:01:19,872 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:01:19,872 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:01:19,872 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 779c17ce2e69dff7c9a8d5348ef6f6d4: 2023-09-19 00:01:19,876 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:01:19,878 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695081679878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081679878"}]},"ts":"1695081679878"} 2023-09-19 00:01:19,881 ERROR [Listener at localhost/37725] master.TableStateManager(95): Unable to get table hbase:acl state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:acl at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2341) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2616) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2640) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2633) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot.setUpBeforeClass(TestMobSecureExportSnapshot.java:55) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-09-19 00:01:19,881 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-19 00:01:19,883 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:01:19,883 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081679883"}]},"ts":"1695081679883"} 2023-09-19 00:01:19,885 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-19 00:01:19,887 DEBUG [Listener at localhost/37725] zookeeper.ReadOnlyZKClient(139): Connect 0x782e04b0 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:19,889 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:01:19,891 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:01:19,891 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:01:19,891 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:01:19,891 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:01:19,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=779c17ce2e69dff7c9a8d5348ef6f6d4, ASSIGN}] 2023-09-19 00:01:19,892 DEBUG [Listener at localhost/37725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10016256, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:19,893 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=779c17ce2e69dff7c9a8d5348ef6f6d4, ASSIGN 2023-09-19 00:01:19,895 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=779c17ce2e69dff7c9a8d5348ef6f6d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39367,1695081676816; forceNewPlan=false, retain=false 2023-09-19 00:01:19,907 DEBUG [hconnection-0x4e0a2980-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:19,919 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/test.cache.data in system properties and HBase conf 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop.tmp.dir in system properties and HBase conf 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop.log.dir in system properties and HBase conf 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-19 00:01:19,922 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/nfs.dump.dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-19 00:01:19,923 INFO [Listener at localhost/37725] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-19 00:01:19,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 00:01:20,045 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 00:01:20,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=779c17ce2e69dff7c9a8d5348ef6f6d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:20,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695081680046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081680046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081680046"}]},"ts":"1695081680046"} 2023-09-19 00:01:20,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 779c17ce2e69dff7c9a8d5348ef6f6d4, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:01:20,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 00:01:20,210 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:01:20,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 779c17ce2e69dff7c9a8d5348ef6f6d4, NAME => 'hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4.', STARTKEY => '', ENDKEY => ''} 2023-09-19 00:01:20,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. service=AccessControlService 2023-09-19 00:01:20,211 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:20,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:20,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:20,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:20,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:20,223 INFO [StoreOpener-779c17ce2e69dff7c9a8d5348ef6f6d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:20,225 DEBUG [StoreOpener-779c17ce2e69dff7c9a8d5348ef6f6d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/l 2023-09-19 00:01:20,225 DEBUG [StoreOpener-779c17ce2e69dff7c9a8d5348ef6f6d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/l 2023-09-19 00:01:20,226 INFO [StoreOpener-779c17ce2e69dff7c9a8d5348ef6f6d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 779c17ce2e69dff7c9a8d5348ef6f6d4 columnFamilyName l 2023-09-19 00:01:20,227 INFO [StoreOpener-779c17ce2e69dff7c9a8d5348ef6f6d4-1] regionserver.HStore(310): Store=779c17ce2e69dff7c9a8d5348ef6f6d4/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:20,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:20,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:20,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:01:20,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:20,243 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 779c17ce2e69dff7c9a8d5348ef6f6d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59273563, jitterRate=-0.11675508320331573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:01:20,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 779c17ce2e69dff7c9a8d5348ef6f6d4: 2023-09-19 00:01:20,245 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4., pid=11, masterSystemTime=1695081680203 2023-09-19 00:01:20,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:01:20,248 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:01:20,249 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=779c17ce2e69dff7c9a8d5348ef6f6d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:20,249 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695081680249"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081680249"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081680249"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081680249"}]},"ts":"1695081680249"} 2023-09-19 00:01:20,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-19 00:01:20,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 779c17ce2e69dff7c9a8d5348ef6f6d4, server=jenkins-hbase4.apache.org,39367,1695081676816 in 204 msec 2023-09-19 00:01:20,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-19 00:01:20,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=779c17ce2e69dff7c9a8d5348ef6f6d4, ASSIGN in 365 msec 2023-09-19 00:01:20,262 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:01:20,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081680263"}]},"ts":"1695081680263"} 2023-09-19 00:01:20,265 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-19 00:01:20,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:01:20,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 460 msec 2023-09-19 00:01:20,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 00:01:20,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-19 00:01:20,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-19 00:01:21,211 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:21,587 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:21,594 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37675_jobhistory____9qb8bd/webapp 2023-09-19 00:01:21,755 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-19 00:01:21,756 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-19 00:01:21,756 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 00:01:21,759 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 00:01:21,842 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:22,185 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:22,459 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-19 00:01:22,487 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37675 2023-09-19 00:01:22,704 WARN [Listener at jenkins-hbase4.apache.org/43871] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:22,991 WARN [Listener at jenkins-hbase4.apache.org/43871] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 00:01:22,991 INFO [Listener at jenkins-hbase4.apache.org/43871] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:22,998 INFO [Listener at jenkins-hbase4.apache.org/43871] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43213_cluster____qgx0gf/webapp 2023-09-19 00:01:23,070 INFO [Listener at jenkins-hbase4.apache.org/43871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 00:01:23,070 INFO [Listener at jenkins-hbase4.apache.org/43871] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-19 00:01:23,070 INFO [Listener at jenkins-hbase4.apache.org/43871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 00:01:23,070 INFO [Listener at jenkins-hbase4.apache.org/43871] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 00:01:23,079 INFO [Listener at jenkins-hbase4.apache.org/43871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:23,277 INFO [Listener at jenkins-hbase4.apache.org/43871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:23,405 INFO [Listener at jenkins-hbase4.apache.org/43871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:23,415 INFO [Listener at jenkins-hbase4.apache.org/43871] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43213 2023-09-19 00:01:23,903 WARN [Listener at jenkins-hbase4.apache.org/41423] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:23,928 WARN [Listener at jenkins-hbase4.apache.org/41423] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 00:01:23,928 INFO [Listener at jenkins-hbase4.apache.org/41423] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:23,935 INFO [Listener at jenkins-hbase4.apache.org/41423] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35365_node____hcmojy/webapp 2023-09-19 00:01:23,990 INFO [Listener at jenkins-hbase4.apache.org/41423] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-19 00:01:23,990 INFO [Listener at jenkins-hbase4.apache.org/41423] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 00:01:23,990 INFO [Listener at jenkins-hbase4.apache.org/41423] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 00:01:23,990 INFO [Listener at jenkins-hbase4.apache.org/41423] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 00:01:24,001 INFO [Listener at jenkins-hbase4.apache.org/41423] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:24,023 INFO [Listener at jenkins-hbase4.apache.org/41423] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:24,093 INFO [Listener at jenkins-hbase4.apache.org/41423] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:24,103 INFO [Listener at jenkins-hbase4.apache.org/41423] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35365 2023-09-19 00:01:24,273 WARN [Listener at jenkins-hbase4.apache.org/39435] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 00:01:24,279 WARN [Listener at jenkins-hbase4.apache.org/39435] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 00:01:24,279 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 00:01:24,281 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:01:24,295 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43595_node____a2n04w/webapp 2023-09-19 00:01:24,400 INFO [Listener at jenkins-hbase4.apache.org/39435] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-19 00:01:24,400 INFO [Listener at jenkins-hbase4.apache.org/39435] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 00:01:24,400 INFO [Listener at jenkins-hbase4.apache.org/39435] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 00:01:24,400 INFO [Listener at jenkins-hbase4.apache.org/39435] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 00:01:24,415 INFO [Listener at jenkins-hbase4.apache.org/39435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:24,429 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-19 00:01:24,431 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-19 00:01:24,432 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-19 00:01:24,441 INFO [Listener at jenkins-hbase4.apache.org/39435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:24,527 INFO [Listener at jenkins-hbase4.apache.org/39435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 00:01:24,533 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43595 2023-09-19 00:01:24,555 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-19 00:01:24,557 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:01:24,626 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=168, AvailableMemoryMB=9810 2023-09-19 00:01:24,627 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-09-19 00:01:24,642 DEBUG [Listener at jenkins-hbase4.apache.org/39435] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-19 00:01:24,647 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-19 00:01:24,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 00:01:24,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:24,658 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:01:24,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-19 00:01:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 00:01:24,661 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:01:24,667 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:24,667 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:24,670 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0 empty. 2023-09-19 00:01:24,670 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18 empty. 2023-09-19 00:01:24,670 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:24,670 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:24,670 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-19 00:01:24,698 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-19 00:01:24,701 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => ff740955fdc16583846b05f04abc3a18, NAME => 'testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:24,701 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 553df45401efd6e2a33ac81732969da0, NAME => 'testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:24,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:24,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing ff740955fdc16583846b05f04abc3a18, disabling compactions & flushes 2023-09-19 00:01:24,739 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:24,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:24,740 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. after waiting 0 ms 2023-09-19 00:01:24,740 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:24,740 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:24,740 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for ff740955fdc16583846b05f04abc3a18: 2023-09-19 00:01:24,741 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:24,742 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 553df45401efd6e2a33ac81732969da0, disabling compactions & flushes 2023-09-19 00:01:24,742 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:24,742 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:24,742 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. after waiting 0 ms 2023-09-19 00:01:24,742 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:24,742 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:24,742 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 553df45401efd6e2a33ac81732969da0: 2023-09-19 00:01:24,748 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:01:24,749 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081684749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081684749"}]},"ts":"1695081684749"} 2023-09-19 00:01:24,750 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081684749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081684749"}]},"ts":"1695081684749"} 2023-09-19 00:01:24,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 00:01:24,801 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 00:01:24,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:01:24,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081684803"}]},"ts":"1695081684803"} 2023-09-19 00:01:24,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-19 00:01:24,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 00:01:24,981 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:01:24,983 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:01:24,983 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:01:24,983 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:01:24,983 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:01:24,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=553df45401efd6e2a33ac81732969da0, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ff740955fdc16583846b05f04abc3a18, ASSIGN}] 2023-09-19 00:01:24,986 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ff740955fdc16583846b05f04abc3a18, ASSIGN 2023-09-19 00:01:24,986 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=553df45401efd6e2a33ac81732969da0, ASSIGN 2023-09-19 00:01:24,988 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ff740955fdc16583846b05f04abc3a18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39367,1695081676816; forceNewPlan=false, retain=false 2023-09-19 00:01:24,988 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=553df45401efd6e2a33ac81732969da0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34277,1695081676849; forceNewPlan=false, retain=false 2023-09-19 00:01:25,138 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 00:01:25,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ff740955fdc16583846b05f04abc3a18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:25,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=553df45401efd6e2a33ac81732969da0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:25,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081685141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081685141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081685141"}]},"ts":"1695081685141"} 2023-09-19 00:01:25,141 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081685141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081685141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081685141"}]},"ts":"1695081685141"} 2023-09-19 00:01:25,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure ff740955fdc16583846b05f04abc3a18, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:01:25,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 553df45401efd6e2a33ac81732969da0, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:01:25,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 00:01:25,299 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:25,300 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 00:01:25,301 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 00:01:25,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:25,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff740955fdc16583846b05f04abc3a18, NAME => 'testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 00:01:25,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. service=AccessControlService 2023-09-19 00:01:25,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:25,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:25,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:25,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:25,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:25,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:25,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 553df45401efd6e2a33ac81732969da0, NAME => 'testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 00:01:25,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. service=AccessControlService 2023-09-19 00:01:25,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:25,310 INFO [StoreOpener-ff740955fdc16583846b05f04abc3a18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:25,310 INFO [StoreOpener-553df45401efd6e2a33ac81732969da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:25,313 DEBUG [StoreOpener-ff740955fdc16583846b05f04abc3a18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf 2023-09-19 00:01:25,313 DEBUG [StoreOpener-ff740955fdc16583846b05f04abc3a18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf 2023-09-19 00:01:25,314 DEBUG [StoreOpener-553df45401efd6e2a33ac81732969da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf 2023-09-19 00:01:25,314 DEBUG [StoreOpener-553df45401efd6e2a33ac81732969da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf 2023-09-19 00:01:25,318 INFO [StoreOpener-553df45401efd6e2a33ac81732969da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 553df45401efd6e2a33ac81732969da0 columnFamilyName cf 2023-09-19 00:01:25,318 INFO [StoreOpener-ff740955fdc16583846b05f04abc3a18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff740955fdc16583846b05f04abc3a18 columnFamilyName cf 2023-09-19 00:01:25,321 INFO [StoreOpener-ff740955fdc16583846b05f04abc3a18-1] regionserver.HStore(310): Store=ff740955fdc16583846b05f04abc3a18/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:25,321 INFO [StoreOpener-553df45401efd6e2a33ac81732969da0-1] regionserver.HStore(310): Store=553df45401efd6e2a33ac81732969da0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:25,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:25,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:25,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:25,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:25,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:25,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:25,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:25,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:25,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff740955fdc16583846b05f04abc3a18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65216614, jitterRate=-0.028196722269058228}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:01:25,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff740955fdc16583846b05f04abc3a18: 2023-09-19 00:01:25,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 553df45401efd6e2a33ac81732969da0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70900638, jitterRate=0.0565018355846405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:01:25,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 553df45401efd6e2a33ac81732969da0: 2023-09-19 00:01:25,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18., pid=15, masterSystemTime=1695081685297 2023-09-19 00:01:25,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0., pid=16, masterSystemTime=1695081685299 2023-09-19 00:01:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:25,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:25,350 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ff740955fdc16583846b05f04abc3a18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:25,351 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081685350"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081685350"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081685350"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081685350"}]},"ts":"1695081685350"} 2023-09-19 00:01:25,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:25,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:25,352 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=553df45401efd6e2a33ac81732969da0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:25,353 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081685352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081685352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081685352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081685352"}]},"ts":"1695081685352"} 2023-09-19 00:01:25,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-19 00:01:25,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure ff740955fdc16583846b05f04abc3a18, server=jenkins-hbase4.apache.org,39367,1695081676816 in 211 msec 2023-09-19 00:01:25,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-19 00:01:25,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 553df45401efd6e2a33ac81732969da0, server=jenkins-hbase4.apache.org,34277,1695081676849 in 211 msec 2023-09-19 00:01:25,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ff740955fdc16583846b05f04abc3a18, ASSIGN in 375 msec 2023-09-19 00:01:25,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-19 00:01:25,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=553df45401efd6e2a33ac81732969da0, ASSIGN in 377 msec 2023-09-19 00:01:25,364 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:01:25,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081685364"}]},"ts":"1695081685364"} 2023-09-19 00:01:25,366 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-19 00:01:25,453 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:01:25,458 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-19 00:01:25,476 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 00:01:25,598 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:25,598 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:25,598 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:25,598 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:25,598 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:01:25,667 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:01:25,667 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-19 00:01:25,668 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:01:25,668 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-19 00:01:25,668 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-19 00:01:25,668 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-19 00:01:25,668 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:01:25,668 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-19 00:01:25,668 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-19 00:01:25,668 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-19 00:01:25,745 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:25,745 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:25,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:25,745 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:25,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:25,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:25,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:25,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0910 sec 2023-09-19 00:01:25,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 00:01:25,769 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-19 00:01:25,773 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-19 00:01:25,774 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:25,776 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:01:25,799 DEBUG [hconnection-0x4e0a2980-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:25,804 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:25,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 00:01:25,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081685820 (current time:1695081685820). 2023-09-19 00:01:25,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:01:25,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x6692f71d to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:25,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68fafd8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:25,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:25,873 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:25,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6692f71d to 127.0.0.1:62806 2023-09-19 00:01:25,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:25,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x3f227013 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:26,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23b37085, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:26,032 DEBUG [hconnection-0x5415bd52-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:26,037 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:26,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f227013 to 127.0.0.1:62806 2023-09-19 00:01:26,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:26,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 00:01:26,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:01:26,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 00:01:26,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 00:01:26,087 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 00:01:26,088 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695082286088 2023-09-19 00:01:26,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 00:01:26,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-19 00:01:26,091 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 00:01:26,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 00:01:26,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-19 00:01:26,096 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 00:01:26,097 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:01:26,097 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:01:26,097 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695082286097 2023-09-19 00:01:26,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,128 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-19 00:01:26,128 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:26,129 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-19 00:01:26,129 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-19 00:01:26,129 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,129 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,197 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:26,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:26,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:26,202 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:01:26,402 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:26,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:26,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:26,403 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 00:01:26,444 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:26,444 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:26,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:26,444 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,444 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:26,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:26,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:26,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:26,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:26,445 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,445 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,446 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,446 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:01:26,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 00:01:26,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 00:01:26,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 00:01:26,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 00:01:26,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 00:01:26,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 00:01:26,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 00:01:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 00:01:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 00:01:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 00:01:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 00:01:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 00:01:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 00:01:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 00:01:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 00:01:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 00:01:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 00:01:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 00:01:26,528 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,528 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,528 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,529 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:26,590 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:26,590 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:26,590 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,590 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:26,590 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:26,591 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,591 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:26,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-19 00:01:26,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aa293af[Count = 1] remaining members to acquire global barrier 2023-09-19 00:01:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:26,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-19 00:01:26,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aa293af[Count = 0] remaining members to acquire global barrier 2023-09-19 00:01:26,597 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-19 00:01:26,597 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,637 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 00:01:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,638 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 00:01:26,638 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,638 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:01:26,639 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 00:01:26,639 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 00:01:26,639 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:26,639 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:26,639 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:26,639 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:26,639 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:26,639 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:01:26,639 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:26,639 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. started... 2023-09-19 00:01:26,639 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. started... 2023-09-19 00:01:26,643 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 553df45401efd6e2a33ac81732969da0: 2023-09-19 00:01:26,643 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ff740955fdc16583846b05f04abc3a18: 2023-09-19 00:01:26,644 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,644 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,650 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:26,650 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:26,653 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:01:26,653 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:01:26,679 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. completed. 2023-09-19 00:01:26,679 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,680 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. completed. 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 00:01:26,680 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 00:01:26,680 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:01:26,704 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:26,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:26,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:26,706 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-19 00:01:26,714 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 00:01:26,714 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:26,714 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 00:01:26,782 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 00:01:26,782 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,782 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:26,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:26,782 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 00:01:26,836 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 00:01:26,836 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,836 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:26,836 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 00:01:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:01:26,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-19 00:01:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:01:26,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-19 00:01:26,848 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-19 00:01:26,848 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:01:26,848 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:01:26,848 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,848 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:01:26,898 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:26,898 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:26,898 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,899 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:26,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:26,899 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,900 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,903 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,903 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:26,903 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,975 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:26,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:26,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:26,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:26,975 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:26,976 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:26,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:26,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-19 00:01:26,976 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,978 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,978 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:26,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:26,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:01:26,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:26,978 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:26,979 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:26,979 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:26,979 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,979 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:26,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:26,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 00:01:26,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:26,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:27,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:27,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:27,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-19 00:01:27,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:27,054 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:27,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695081686088Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695081686998 (+910 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695081686998Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695081686999 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695081687015 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695081687041 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695081687053 (+12 ms) 2023-09-19 00:01:27,057 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 00:01:27,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 967 msec 2023-09-19 00:01:27,206 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:27,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:27,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:01:27,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34277] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:01:27,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39367] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:01:27,237 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-19 00:01:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:27,238 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:01:27,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 00:01:27,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081687254 (current time:1695081687254). 2023-09-19 00:01:27,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:01:27,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x59e886e1 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:27,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a6514f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:27,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:27,309 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:27,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59e886e1 to 127.0.0.1:62806 2023-09-19 00:01:27,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:27,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x27c17428 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:27,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a0321bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:27,362 DEBUG [hconnection-0x38c3709b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:27,366 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:27,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27c17428 to 127.0.0.1:62806 2023-09-19 00:01:27,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:27,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 00:01:27,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:01:27,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 00:01:27,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 00:01:27,376 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 00:01:27,377 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695082287377 2023-09-19 00:01:27,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 00:01:27,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-19 00:01:27,379 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:01:27,379 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:01:27,380 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 00:01:27,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 00:01:27,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-19 00:01:27,383 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 00:01:27,384 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695082287384 2023-09-19 00:01:27,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-19 00:01:27,403 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-19 00:01:27,404 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:27,404 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-19 00:01:27,404 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-19 00:01:27,428 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,428 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,479 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:27,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:27,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:27,481 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:01:27,490 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:27,490 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:27,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:27,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:27,490 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,490 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:27,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:27,491 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,491 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,491 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,491 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:01:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 00:01:27,492 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 00:01:27,492 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:27,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 00:01:27,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 00:01:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 00:01:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 00:01:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 00:01:27,495 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 00:01:27,495 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 00:01:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:27,495 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 00:01:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 00:01:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 00:01:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 00:01:27,495 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 00:01:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 00:01:27,575 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,575 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:27,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:27,614 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:27,614 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,615 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:27,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-19 00:01:27,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47f72289[Count = 1] remaining members to acquire global barrier 2023-09-19 00:01:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:27,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-19 00:01:27,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47f72289[Count = 0] remaining members to acquire global barrier 2023-09-19 00:01:27,619 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-19 00:01:27,619 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,682 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:27,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:27,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:27,684 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 00:01:27,718 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,718 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,718 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,718 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 00:01:27,718 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:27,719 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:27,719 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,719 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:01:27,719 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. started... 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 00:01:27,719 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:27,719 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:01:27,719 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. started... 2023-09-19 00:01:27,719 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ff740955fdc16583846b05f04abc3a18 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-19 00:01:27,720 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 553df45401efd6e2a33ac81732969da0 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-19 00:01:27,776 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 00:01:27,776 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:27,776 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 00:01:27,870 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919230876c1802148cabdf8cc52a12965c7 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919230876c1802148cabdf8cc52a12965c7 2023-09-19 00:01:27,870 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919c509d3db3c064db4b7350289f84eaeb2 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919c509d3db3c064db4b7350289f84eaeb2 2023-09-19 00:01:27,905 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/.tmp/cf/886fe888d8834d888273a45947f8916a 2023-09-19 00:01:27,905 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/.tmp/cf/f0c8bd7f578a4432903582a21621a5c5 2023-09-19 00:01:27,917 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/.tmp/cf/f0c8bd7f578a4432903582a21621a5c5 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf/f0c8bd7f578a4432903582a21621a5c5 2023-09-19 00:01:27,917 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/.tmp/cf/886fe888d8834d888273a45947f8916a as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf/886fe888d8834d888273a45947f8916a 2023-09-19 00:01:27,931 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf/886fe888d8834d888273a45947f8916a, entries=47, sequenceid=6, filesize=12.8 K 2023-09-19 00:01:27,931 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf/f0c8bd7f578a4432903582a21621a5c5, entries=3, sequenceid=6, filesize=5.4 K 2023-09-19 00:01:27,937 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ff740955fdc16583846b05f04abc3a18 in 217ms, sequenceid=6, compaction requested=false 2023-09-19 00:01:27,937 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 553df45401efd6e2a33ac81732969da0 in 217ms, sequenceid=6, compaction requested=false 2023-09-19 00:01:27,937 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-19 00:01:27,937 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-19 00:01:27,940 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ff740955fdc16583846b05f04abc3a18: 2023-09-19 00:01:27,940 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 553df45401efd6e2a33ac81732969da0: 2023-09-19 00:01:27,940 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 00:01:27,940 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 00:01:27,940 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:27,940 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:27,941 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf/886fe888d8834d888273a45947f8916a] hfiles 2023-09-19 00:01:27,941 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf/f0c8bd7f578a4432903582a21621a5c5] hfiles 2023-09-19 00:01:27,941 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf/886fe888d8834d888273a45947f8916a for snapshot=snaptb0-testExportWithTargetName 2023-09-19 00:01:27,941 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf/f0c8bd7f578a4432903582a21621a5c5 for snapshot=snaptb0-testExportWithTargetName 2023-09-19 00:01:27,971 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. completed. 2023-09-19 00:01:27,971 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:01:27,972 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. completed. 2023-09-19 00:01:27,972 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 00:01:27,972 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:01:27,974 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 00:01:27,974 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,974 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 00:01:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:27,974 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:27,974 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:27,974 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,975 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 00:01:27,974 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 00:01:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:01:27,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-19 00:01:27,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:27,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:27,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:27,984 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:27,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:27,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:27,986 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-19 00:01:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:01:27,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-19 00:01:27,986 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-19 00:01:27,986 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:01:27,986 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:01:27,986 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-19 00:01:27,986 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:01:27,988 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,988 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,988 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,988 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,989 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:27,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,989 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:27,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:27,988 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,989 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:27,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:27,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,990 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,991 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,992 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:27,993 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 00:01:27,993 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:28,005 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:28,005 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:28,005 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:28,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:28,005 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:28,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:28,006 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:28,005 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:28,005 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,005 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:28,007 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:28,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:28,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-19 00:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:28,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-19 00:01:28,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:28,006 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:28,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 00:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:28,007 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:28,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:28,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:28,007 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,008 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:28,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:28,008 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,008 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:28,008 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:28,008 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,008 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919c509d3db3c064db4b7350289f84eaeb2, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919230876c1802148cabdf8cc52a12965c7] mob files 2023-09-19 00:01:28,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919c509d3db3c064db4b7350289f84eaeb2 2023-09-19 00:01:28,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919230876c1802148cabdf8cc52a12965c7 2023-09-19 00:01:28,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-19 00:01:28,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-19 00:01:28,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,072 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 00:01:28,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695081687377Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695081688028 (+651 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695081688028Loading Region manifests for snaptb0-testExportWithTargetName at 1695081688028Writing data manifest for snaptb0-testExportWithTargetName at 1695081688034 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695081688058 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695081688071 (+13 ms) 2023-09-19 00:01:28,074 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 00:01:28,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 696 msec 2023-09-19 00:01:28,486 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:28,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 00:01:28,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:01:28,489 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489 2023-09-19 00:01:28,490 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:28,529 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:28,529 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1272870744_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-19 00:01:28,529 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-19 00:01:28,550 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-19 00:01:28,648 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:28,649 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:28,650 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:28,651 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,556 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-2976619563266507130.jar 2023-09-19 00:01:29,556 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,557 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,624 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-6788203698298781955.jar 2023-09-19 00:01:29,625 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,625 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,626 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,626 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,627 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,627 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:29,627 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 00:01:29,628 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 00:01:29,628 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 00:01:29,629 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 00:01:29,629 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 00:01:29,630 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 00:01:29,631 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 00:01:29,631 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 00:01:29,632 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 00:01:29,633 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 00:01:29,638 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:29,639 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:29,639 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:01:29,640 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:29,640 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:29,641 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:01:29,641 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:01:30,490 WARN [Listener at jenkins-hbase4.apache.org/39435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 00:01:30,497 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-19 00:01:30,505 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-19 00:01:30,826 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:01:30,969 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:01:30,969 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:01:31,373 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0001_000001 (auth:SIMPLE) 2023-09-19 00:01:35,782 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0001_000001 (auth:SIMPLE) 2023-09-19 00:01:38,041 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0001_000001 (auth:SIMPLE) 2023-09-19 00:01:40,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0001_000001 (auth:SIMPLE) 2023-09-19 00:01:42,342 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 00:01:42,346 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 00:01:42,357 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-19 00:01:42,357 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 00:01:42,358 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 00:01:42,358 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-19 00:01:42,359 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-19 00:01:42,359 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-19 00:01:42,359 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489/.hbase-snapshot/testExportWithTargetName 2023-09-19 00:01:42,360 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-19 00:01:42,360 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081688489/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-19 00:01:42,372 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-19 00:01:42,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-19 00:01:42,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:42,392 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081702392"}]},"ts":"1695081702392"} 2023-09-19 00:01:42,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 00:01:42,394 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-19 00:01:42,397 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-19 00:01:42,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=553df45401efd6e2a33ac81732969da0, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ff740955fdc16583846b05f04abc3a18, UNASSIGN}] 2023-09-19 00:01:42,402 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=553df45401efd6e2a33ac81732969da0, UNASSIGN 2023-09-19 00:01:42,402 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ff740955fdc16583846b05f04abc3a18, UNASSIGN 2023-09-19 00:01:42,403 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=553df45401efd6e2a33ac81732969da0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:42,403 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ff740955fdc16583846b05f04abc3a18, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:42,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081702403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081702403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081702403"}]},"ts":"1695081702403"} 2023-09-19 00:01:42,403 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081702403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081702403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081702403"}]},"ts":"1695081702403"} 2023-09-19 00:01:42,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure ff740955fdc16583846b05f04abc3a18, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:01:42,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 553df45401efd6e2a33ac81732969da0, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:01:42,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 00:01:42,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:42,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff740955fdc16583846b05f04abc3a18, disabling compactions & flushes 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 553df45401efd6e2a33ac81732969da0, disabling compactions & flushes 2023-09-19 00:01:42,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:42,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. after waiting 0 ms 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. after waiting 0 ms 2023-09-19 00:01:42,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:42,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:01:42,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:01:42,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18. 2023-09-19 00:01:42,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff740955fdc16583846b05f04abc3a18: 2023-09-19 00:01:42,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:01:42,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:01:42,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0. 2023-09-19 00:01:42,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 553df45401efd6e2a33ac81732969da0: 2023-09-19 00:01:42,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:42,590 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ff740955fdc16583846b05f04abc3a18, regionState=CLOSED 2023-09-19 00:01:42,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:42,590 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081702590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081702590"}]},"ts":"1695081702590"} 2023-09-19 00:01:42,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=553df45401efd6e2a33ac81732969da0, regionState=CLOSED 2023-09-19 00:01:42,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695081702591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081702591"}]},"ts":"1695081702591"} 2023-09-19 00:01:42,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-19 00:01:42,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure ff740955fdc16583846b05f04abc3a18, server=jenkins-hbase4.apache.org,39367,1695081676816 in 187 msec 2023-09-19 00:01:42,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-19 00:01:42,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 553df45401efd6e2a33ac81732969da0, server=jenkins-hbase4.apache.org,34277,1695081676849 in 187 msec 2023-09-19 00:01:42,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ff740955fdc16583846b05f04abc3a18, UNASSIGN in 196 msec 2023-09-19 00:01:42,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-19 00:01:42,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=553df45401efd6e2a33ac81732969da0, UNASSIGN in 197 msec 2023-09-19 00:01:42,599 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081702599"}]},"ts":"1695081702599"} 2023-09-19 00:01:42,601 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-19 00:01:42,602 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-19 00:01:42,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-09-19 00:01:42,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 00:01:42,697 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-19 00:01:42,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-19 00:01:42,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:42,712 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:42,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-19 00:01:42,714 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:42,718 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-19 00:01:42,720 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:42,720 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:42,720 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,720 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,720 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,720 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-19 00:01:42,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-19 00:01:42,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-19 00:01:42,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:42,724 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:42,724 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/recovered.edits] 2023-09-19 00:01:42,724 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/recovered.edits] 2023-09-19 00:01:42,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-19 00:01:42,732 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf/f0c8bd7f578a4432903582a21621a5c5 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/cf/f0c8bd7f578a4432903582a21621a5c5 2023-09-19 00:01:42,732 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf/886fe888d8834d888273a45947f8916a to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/cf/886fe888d8834d888273a45947f8916a 2023-09-19 00:01:42,736 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0/recovered.edits/9.seqid 2023-09-19 00:01:42,737 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18/recovered.edits/9.seqid 2023-09-19 00:01:42,737 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/553df45401efd6e2a33ac81732969da0 2023-09-19 00:01:42,737 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportWithTargetName/ff740955fdc16583846b05f04abc3a18 2023-09-19 00:01:42,737 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-19 00:01:42,738 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-19 00:01:42,739 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-19 00:01:42,742 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919c509d3db3c064db4b7350289f84eaeb2 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919c509d3db3c064db4b7350289f84eaeb2 2023-09-19 00:01:42,744 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919230876c1802148cabdf8cc52a12965c7 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919230876c1802148cabdf8cc52a12965c7 2023-09-19 00:01:42,744 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-19 00:01:42,747 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:42,768 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-19 00:01:42,771 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-19 00:01:42,773 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:42,773 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-19 00:01:42,773 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081702773"}]},"ts":"9223372036854775807"} 2023-09-19 00:01:42,773 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081702773"}]},"ts":"9223372036854775807"} 2023-09-19 00:01:42,775 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 00:01:42,775 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 553df45401efd6e2a33ac81732969da0, NAME => 'testtb-testExportWithTargetName,,1695081684653.553df45401efd6e2a33ac81732969da0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ff740955fdc16583846b05f04abc3a18, NAME => 'testtb-testExportWithTargetName,1,1695081684653.ff740955fdc16583846b05f04abc3a18.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 00:01:42,776 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-19 00:01:42,776 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695081702776"}]},"ts":"9223372036854775807"} 2023-09-19 00:01:42,777 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-19 00:01:42,780 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 00:01:42,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-09-19 00:01:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-19 00:01:42,831 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-19 00:01:42,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-19 00:01:42,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-19 00:01:42,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-19 00:01:42,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-19 00:01:42,891 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 710) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34639 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1286 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737099731_1 at /127.0.0.1:49532 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737099731_1 at /127.0.0.1:33478 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:46659 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:54666 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41423 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:33496 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:49550 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 191) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=9048 (was 9810) 2023-09-19 00:01:42,892 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-19 00:01:42,914 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=170, AvailableMemoryMB=9047 2023-09-19 00:01:42,914 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-19 00:01:42,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 00:01:42,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:42,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:01:42,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-19 00:01:42,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:01:42,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 00:01:42,932 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:42,932 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:42,933 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1 empty. 2023-09-19 00:01:42,933 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba empty. 2023-09-19 00:01:42,933 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:42,934 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:42,934 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-19 00:01:42,952 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-19 00:01:42,954 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c8bd95e3eeeefb50dd0613f5d33280ba, NAME => 'testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:42,954 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2075436f2b68c573c181dbaa20b4dae1, NAME => 'testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:42,986 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:42,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c8bd95e3eeeefb50dd0613f5d33280ba, disabling compactions & flushes 2023-09-19 00:01:42,996 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:42,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:42,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. after waiting 0 ms 2023-09-19 00:01:42,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:42,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:42,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c8bd95e3eeeefb50dd0613f5d33280ba: 2023-09-19 00:01:42,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:42,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2075436f2b68c573c181dbaa20b4dae1, disabling compactions & flushes 2023-09-19 00:01:42,998 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:42,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:42,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. after waiting 0 ms 2023-09-19 00:01:42,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:42,998 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:42,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2075436f2b68c573c181dbaa20b4dae1: 2023-09-19 00:01:43,001 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:01:43,002 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081703002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081703002"}]},"ts":"1695081703002"} 2023-09-19 00:01:43,002 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081703002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081703002"}]},"ts":"1695081703002"} 2023-09-19 00:01:43,007 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 00:01:43,008 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:01:43,008 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081703008"}]},"ts":"1695081703008"} 2023-09-19 00:01:43,012 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-19 00:01:43,015 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:01:43,016 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:01:43,016 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:01:43,016 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:01:43,016 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:01:43,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8bd95e3eeeefb50dd0613f5d33280ba, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2075436f2b68c573c181dbaa20b4dae1, ASSIGN}] 2023-09-19 00:01:43,020 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2075436f2b68c573c181dbaa20b4dae1, ASSIGN 2023-09-19 00:01:43,020 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8bd95e3eeeefb50dd0613f5d33280ba, ASSIGN 2023-09-19 00:01:43,021 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8bd95e3eeeefb50dd0613f5d33280ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39367,1695081676816; forceNewPlan=false, retain=false 2023-09-19 00:01:43,021 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2075436f2b68c573c181dbaa20b4dae1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34277,1695081676849; forceNewPlan=false, retain=false 2023-09-19 00:01:43,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 00:01:43,171 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 00:01:43,174 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c8bd95e3eeeefb50dd0613f5d33280ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,174 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2075436f2b68c573c181dbaa20b4dae1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,174 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081703174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081703174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081703174"}]},"ts":"1695081703174"} 2023-09-19 00:01:43,174 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081703174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081703174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081703174"}]},"ts":"1695081703174"} 2023-09-19 00:01:43,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure c8bd95e3eeeefb50dd0613f5d33280ba, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:01:43,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 2075436f2b68c573c181dbaa20b4dae1, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:01:43,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 00:01:43,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:43,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:43,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8bd95e3eeeefb50dd0613f5d33280ba, NAME => 'testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 00:01:43,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2075436f2b68c573c181dbaa20b4dae1, NAME => 'testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 00:01:43,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. service=AccessControlService 2023-09-19 00:01:43,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:43,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:43,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:43,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:43,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:43,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. service=AccessControlService 2023-09-19 00:01:43,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:01:43,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:43,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:43,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:43,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:43,336 INFO [StoreOpener-c8bd95e3eeeefb50dd0613f5d33280ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:43,337 INFO [StoreOpener-2075436f2b68c573c181dbaa20b4dae1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:43,338 DEBUG [StoreOpener-c8bd95e3eeeefb50dd0613f5d33280ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf 2023-09-19 00:01:43,338 DEBUG [StoreOpener-c8bd95e3eeeefb50dd0613f5d33280ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf 2023-09-19 00:01:43,339 INFO [StoreOpener-c8bd95e3eeeefb50dd0613f5d33280ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8bd95e3eeeefb50dd0613f5d33280ba columnFamilyName cf 2023-09-19 00:01:43,339 DEBUG [StoreOpener-2075436f2b68c573c181dbaa20b4dae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf 2023-09-19 00:01:43,339 DEBUG [StoreOpener-2075436f2b68c573c181dbaa20b4dae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf 2023-09-19 00:01:43,339 INFO [StoreOpener-2075436f2b68c573c181dbaa20b4dae1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2075436f2b68c573c181dbaa20b4dae1 columnFamilyName cf 2023-09-19 00:01:43,340 INFO [StoreOpener-c8bd95e3eeeefb50dd0613f5d33280ba-1] regionserver.HStore(310): Store=c8bd95e3eeeefb50dd0613f5d33280ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:43,342 INFO [StoreOpener-2075436f2b68c573c181dbaa20b4dae1-1] regionserver.HStore(310): Store=2075436f2b68c573c181dbaa20b4dae1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:01:43,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:43,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:43,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:43,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:43,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:43,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:43,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:43,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:01:43,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c8bd95e3eeeefb50dd0613f5d33280ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61798941, jitterRate=-0.07912401854991913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:01:43,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c8bd95e3eeeefb50dd0613f5d33280ba: 2023-09-19 00:01:43,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2075436f2b68c573c181dbaa20b4dae1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67929823, jitterRate=0.012233242392539978}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:01:43,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2075436f2b68c573c181dbaa20b4dae1: 2023-09-19 00:01:43,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba., pid=30, masterSystemTime=1695081703330 2023-09-19 00:01:43,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:43,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:43,354 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c8bd95e3eeeefb50dd0613f5d33280ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,354 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081703354"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081703354"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081703354"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081703354"}]},"ts":"1695081703354"} 2023-09-19 00:01:43,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1., pid=31, masterSystemTime=1695081703331 2023-09-19 00:01:43,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-19 00:01:43,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure c8bd95e3eeeefb50dd0613f5d33280ba, server=jenkins-hbase4.apache.org,39367,1695081676816 in 180 msec 2023-09-19 00:01:43,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:43,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:43,362 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2075436f2b68c573c181dbaa20b4dae1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8bd95e3eeeefb50dd0613f5d33280ba, ASSIGN in 343 msec 2023-09-19 00:01:43,362 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081703362"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081703362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081703362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081703362"}]},"ts":"1695081703362"} 2023-09-19 00:01:43,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-19 00:01:43,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 2075436f2b68c573c181dbaa20b4dae1, server=jenkins-hbase4.apache.org,34277,1695081676849 in 186 msec 2023-09-19 00:01:43,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-19 00:01:43,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2075436f2b68c573c181dbaa20b4dae1, ASSIGN in 350 msec 2023-09-19 00:01:43,372 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:01:43,372 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081703372"}]},"ts":"1695081703372"} 2023-09-19 00:01:43,374 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-19 00:01:43,378 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:01:43,378 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-19 00:01:43,380 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 00:01:43,382 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:43,382 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:43,382 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:43,382 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:43,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:43,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:43,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:43,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:01:43,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 466 msec 2023-09-19 00:01:43,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 00:01:43,530 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-19 00:01:43,532 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-19 00:01:43,533 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:43,535 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:01:43,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:01:43,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081703549 (current time:1695081703549). 2023-09-19 00:01:43,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:01:43,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x7de0800e to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:43,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aee88ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:43,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:43,565 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:43,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7de0800e to 127.0.0.1:62806 2023-09-19 00:01:43,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:43,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x5e1de471 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:43,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2784ef4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:43,574 DEBUG [hconnection-0x29a1085e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:43,575 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:43,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e1de471 to 127.0.0.1:62806 2023-09-19 00:01:43,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:43,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 00:01:43,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:01:43,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:01:43,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:01:43,585 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:01:43,586 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695082303586 2023-09-19 00:01:43,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-19 00:01:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:01:43,592 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:01:43,592 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:01:43,594 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:01:43,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 00:01:43,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-09-19 00:01:43,597 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 00:01:43,598 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695082303598 2023-09-19 00:01:43,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,620 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-19 00:01:43,620 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,622 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-19 00:01:43,622 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-19 00:01:43,623 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,623 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,624 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,624 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,624 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,624 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,625 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,625 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,625 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,625 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:01:43,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,626 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 00:01:43,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,629 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 00:01:43,629 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,634 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 00:01:43,634 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 00:01:43,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,634 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 00:01:43,634 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 00:01:43,634 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,634 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 00:01:43,635 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 00:01:43,635 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 00:01:43,634 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,635 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 00:01:43,636 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 00:01:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 00:01:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 00:01:43,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,639 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:43,645 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,645 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,645 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:43,645 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,645 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:43,645 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,645 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:43,645 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,646 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:43,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:43,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:43,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-19 00:01:43,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@252ddd41[Count = 1] remaining members to acquire global barrier 2023-09-19 00:01:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:43,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-19 00:01:43,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@252ddd41[Count = 0] remaining members to acquire global barrier 2023-09-19 00:01:43,650 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 00:01:43,650 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:01:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:01:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,653 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 00:01:43,654 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:01:43,654 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:01:43,654 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,654 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:43,654 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:43,654 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:43,654 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:43,654 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:43,654 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,654 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:01:43,654 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:43,654 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. started... 2023-09-19 00:01:43,655 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. started... 2023-09-19 00:01:43,656 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2075436f2b68c573c181dbaa20b4dae1: 2023-09-19 00:01:43,656 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c8bd95e3eeeefb50dd0613f5d33280ba: 2023-09-19 00:01:43,656 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,656 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:43,656 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,656 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 00:01:43,656 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:01:43,657 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:43,656 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:43,658 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:01:43,657 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 00:01:43,679 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. completed. 2023-09-19 00:01:43,679 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:43,679 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:43,679 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:43,679 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,679 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 00:01:43,680 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:01:43,681 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,681 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 00:01:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:43,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 00:01:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:43,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,688 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. completed. 2023-09-19 00:01:43,689 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 00:01:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:01:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:01:43,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 00:01:43,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,691 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 00:01:43,691 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:43,691 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 00:01:43,693 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:43,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:43,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:43,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:43,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:01:43,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,694 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:01:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:01:43,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 00:01:43,698 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-19 00:01:43,698 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:01:43,698 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:01:43,698 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,698 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:01:43,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:43,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:43,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:43,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:43,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:43,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:43,701 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,702 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:43,703 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:43,705 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,705 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,705 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-19 00:01:43,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:01:43,710 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,712 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,712 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,712 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,712 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,712 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,712 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,710 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:43,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:43,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:43,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:43,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 00:01:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:43,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,756 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-19 00:01:43,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,757 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:43,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695081703586Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695081703726 (+140 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695081703726Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695081703727 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695081703731 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695081703748 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695081703756 (+8 ms) 2023-09-19 00:01:43,760 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 00:01:43,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 173 msec 2023-09-19 00:01:43,895 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:43,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:01:43,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:01:43,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39367] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:01:43,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34277] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:01:43,908 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-19 00:01:43,908 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:43,908 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:01:43,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:01:43,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081703922 (current time:1695081703922). 2023-09-19 00:01:43,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:01:43,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x1544625c to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:43,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a583183, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:43,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:43,936 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:43,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1544625c to 127.0.0.1:62806 2023-09-19 00:01:43,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:43,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x59ef7cd1 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:01:43,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4304379, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:01:43,946 DEBUG [hconnection-0x77fce9bc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:01:43,949 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:01:43,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59ef7cd1 to 127.0.0.1:62806 2023-09-19 00:01:43,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:01:43,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 00:01:43,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:01:43,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:01:43,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:01:43,960 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:01:43,961 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695082303961 2023-09-19 00:01:43,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-19 00:01:43,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:01:43,963 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:01:43,963 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:01:43,965 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:01:43,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 00:01:43,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-19 00:01:43,969 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 00:01:43,970 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695082303969 2023-09-19 00:01:43,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-19 00:01:43,987 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-19 00:01:43,987 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,988 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-19 00:01:43,988 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-19 00:01:43,989 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,989 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,990 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,990 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,990 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:43,990 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,991 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,991 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,991 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,991 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:01:43,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 00:01:43,992 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 00:01:43,992 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 00:01:43,992 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,992 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 00:01:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 00:01:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 00:01:43,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 00:01:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 00:01:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 00:01:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 00:01:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 00:01:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:01:43,996 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 00:01:43,996 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 00:01:43,996 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 00:01:43,997 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,997 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:43,997 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:43,997 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:01:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:44,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-19 00:01:44,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bcc0da0[Count = 1] remaining members to acquire global barrier 2023-09-19 00:01:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:44,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-19 00:01:44,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bcc0da0[Count = 0] remaining members to acquire global barrier 2023-09-19 00:01:44,002 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 00:01:44,002 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,004 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,004 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,004 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:01:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:01:44,005 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,005 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:44,005 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. started... 2023-09-19 00:01:44,005 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:01:44,005 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. started... 2023-09-19 00:01:44,005 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c8bd95e3eeeefb50dd0613f5d33280ba 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-19 00:01:44,005 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,006 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:01:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:01:44,006 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2075436f2b68c573c181dbaa20b4dae1 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-19 00:01:44,006 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:01:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 00:01:44,006 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:01:44,007 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 00:01:44,007 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:44,007 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 00:01:44,039 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919effdffc368434e70acfa8852c578fd2d to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919effdffc368434e70acfa8852c578fd2d 2023-09-19 00:01:44,045 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309192c153afde1fb419885ea2784b34aa485 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309192c153afde1fb419885ea2784b34aa485 2023-09-19 00:01:44,057 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/.tmp/cf/4b6f3a9b466447d7aca12c671967e890 2023-09-19 00:01:44,063 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:44,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:01:44,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:44,065 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:01:44,075 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/.tmp/cf/4b6f3a9b466447d7aca12c671967e890 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf/4b6f3a9b466447d7aca12c671967e890 2023-09-19 00:01:44,082 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf/4b6f3a9b466447d7aca12c671967e890, entries=5, sequenceid=6, filesize=5.7 K 2023-09-19 00:01:44,083 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c8bd95e3eeeefb50dd0613f5d33280ba in 78ms, sequenceid=6, compaction requested=false 2023-09-19 00:01:44,083 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-19 00:01:44,084 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c8bd95e3eeeefb50dd0613f5d33280ba: 2023-09-19 00:01:44,084 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 00:01:44,084 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:44,084 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf/4b6f3a9b466447d7aca12c671967e890] hfiles 2023-09-19 00:01:44,084 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf/4b6f3a9b466447d7aca12c671967e890 for snapshot=snaptb0-testExportFileSystemState 2023-09-19 00:01:44,092 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. completed. 2023-09-19 00:01:44,092 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 00:01:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:01:44,098 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 00:01:44,098 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,098 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:44,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:44,099 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 00:01:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:01:44,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 00:01:44,265 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:44,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:01:44,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:01:44,267 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 00:01:44,472 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/.tmp/cf/68064540340c428eb7d74fbccce3613e 2023-09-19 00:01:44,479 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/.tmp/cf/68064540340c428eb7d74fbccce3613e as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf/68064540340c428eb7d74fbccce3613e 2023-09-19 00:01:44,485 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf/68064540340c428eb7d74fbccce3613e, entries=45, sequenceid=6, filesize=12.5 K 2023-09-19 00:01:44,486 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 2075436f2b68c573c181dbaa20b4dae1 in 481ms, sequenceid=6, compaction requested=false 2023-09-19 00:01:44,488 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2075436f2b68c573c181dbaa20b4dae1: 2023-09-19 00:01:44,488 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 00:01:44,488 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:01:44,488 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf/68064540340c428eb7d74fbccce3613e] hfiles 2023-09-19 00:01:44,488 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf/68064540340c428eb7d74fbccce3613e for snapshot=snaptb0-testExportFileSystemState 2023-09-19 00:01:44,499 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. completed. 2023-09-19 00:01:44,499 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 00:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:01:44,502 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 00:01:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 00:01:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:01:44,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 00:01:44,508 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-19 00:01:44,508 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:01:44,508 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:01:44,508 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-19 00:01:44,508 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:01:44,510 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:01:44,510 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:44,510 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:44,510 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:44,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,511 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:01:44,511 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,512 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:01:44,514 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 00:01:44,514 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,514 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,517 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,517 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,518 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:44,518 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:44,518 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:44,518 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:44,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:44,518 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:44,518 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:01:44,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-19 00:01:44,518 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:01:44,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-19 00:01:44,518 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:44,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 00:01:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:44,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:01:44,520 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:01:44,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:44,519 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:01:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:01:44,521 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:44,521 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,521 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:44,521 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:44,521 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,521 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:01:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:01:44,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309192c153afde1fb419885ea2784b34aa485, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919effdffc368434e70acfa8852c578fd2d] mob files 2023-09-19 00:01:44,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309192c153afde1fb419885ea2784b34aa485 2023-09-19 00:01:44,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919effdffc368434e70acfa8852c578fd2d 2023-09-19 00:01:44,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-19 00:01:44,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-19 00:01:44,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,557 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695081703961Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695081704531 (+570 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695081704531Loading Region manifests for snaptb0-testExportFileSystemState at 1695081704532 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1695081704535 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695081704547 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695081704556 (+9 ms) 2023-09-19 00:01:44,559 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 00:01:44,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 596 msec 2023-09-19 00:01:44,568 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:01:44,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:01:44,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:01:44,569 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569 2023-09-19 00:01:44,569 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:44,592 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:01:44,592 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-509335699_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,592 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-19 00:01:44,604 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 00:01:44,638 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:44,639 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:44,639 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:44,639 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,545 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-5175524408439824856.jar 2023-09-19 00:01:45,545 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,546 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,613 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-3250413879524698012.jar 2023-09-19 00:01:45,614 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,614 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,615 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,615 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,615 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,616 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 00:01:45,616 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 00:01:45,617 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 00:01:45,617 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 00:01:45,618 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 00:01:45,618 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 00:01:45,619 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 00:01:45,619 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 00:01:45,619 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 00:01:45,620 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 00:01:45,620 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 00:01:45,621 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:45,621 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:45,622 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:01:45,622 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:45,622 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:01:45,623 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:01:45,624 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:01:46,884 WARN [Listener at jenkins-hbase4.apache.org/39435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 00:01:46,887 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-19 00:01:46,890 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-19 00:01:46,910 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0001_000001 (auth:SIMPLE) 2023-09-19 00:01:46,982 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:01:46,982 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:01:47,566 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0002_000001 (auth:SIMPLE) 2023-09-19 00:01:48,204 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:01:51,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0002_000001 (auth:SIMPLE) 2023-09-19 00:01:54,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0002_000001 (auth:SIMPLE) 2023-09-19 00:01:57,131 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0002_000001 (auth:SIMPLE) 2023-09-19 00:01:59,111 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 00:01:59,112 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 00:01:59,121 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-19 00:01:59,121 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 00:01:59,122 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 00:01:59,122 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 00:01:59,122 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-19 00:01:59,123 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-19 00:01:59,123 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 00:01:59,123 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-19 00:01:59,123 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081704569/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-19 00:01:59,130 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-19 00:01:59,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-19 00:01:59,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:59,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 00:01:59,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081719135"}]},"ts":"1695081719135"} 2023-09-19 00:01:59,137 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-19 00:01:59,139 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-19 00:01:59,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8bd95e3eeeefb50dd0613f5d33280ba, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2075436f2b68c573c181dbaa20b4dae1, UNASSIGN}] 2023-09-19 00:01:59,143 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8bd95e3eeeefb50dd0613f5d33280ba, UNASSIGN 2023-09-19 00:01:59,143 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2075436f2b68c573c181dbaa20b4dae1, UNASSIGN 2023-09-19 00:01:59,144 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c8bd95e3eeeefb50dd0613f5d33280ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:01:59,144 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081719143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081719143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081719143"}]},"ts":"1695081719143"} 2023-09-19 00:01:59,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2075436f2b68c573c181dbaa20b4dae1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:59,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081719144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081719144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081719144"}]},"ts":"1695081719144"} 2023-09-19 00:01:59,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure c8bd95e3eeeefb50dd0613f5d33280ba, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:01:59,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 2075436f2b68c573c181dbaa20b4dae1, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:01:59,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 00:01:59,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:59,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c8bd95e3eeeefb50dd0613f5d33280ba, disabling compactions & flushes 2023-09-19 00:01:59,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:59,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:59,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. after waiting 0 ms 2023-09-19 00:01:59,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:59,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:59,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2075436f2b68c573c181dbaa20b4dae1, disabling compactions & flushes 2023-09-19 00:01:59,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:59,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:59,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. after waiting 0 ms 2023-09-19 00:01:59,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:59,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:01:59,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:01:59,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:01:59,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba. 2023-09-19 00:01:59,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:01:59,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c8bd95e3eeeefb50dd0613f5d33280ba: 2023-09-19 00:01:59,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1. 2023-09-19 00:01:59,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2075436f2b68c573c181dbaa20b4dae1: 2023-09-19 00:01:59,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:59,315 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c8bd95e3eeeefb50dd0613f5d33280ba, regionState=CLOSED 2023-09-19 00:01:59,315 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081719315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081719315"}]},"ts":"1695081719315"} 2023-09-19 00:01:59,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:59,316 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2075436f2b68c573c181dbaa20b4dae1, regionState=CLOSED 2023-09-19 00:01:59,316 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695081719316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081719316"}]},"ts":"1695081719316"} 2023-09-19 00:01:59,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-19 00:01:59,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure c8bd95e3eeeefb50dd0613f5d33280ba, server=jenkins-hbase4.apache.org,39367,1695081676816 in 170 msec 2023-09-19 00:01:59,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-19 00:01:59,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 2075436f2b68c573c181dbaa20b4dae1, server=jenkins-hbase4.apache.org,34277,1695081676849 in 170 msec 2023-09-19 00:01:59,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8bd95e3eeeefb50dd0613f5d33280ba, UNASSIGN in 179 msec 2023-09-19 00:01:59,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-19 00:01:59,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2075436f2b68c573c181dbaa20b4dae1, UNASSIGN in 179 msec 2023-09-19 00:01:59,322 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081719322"}]},"ts":"1695081719322"} 2023-09-19 00:01:59,323 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-19 00:01:59,325 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-19 00:01:59,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 196 msec 2023-09-19 00:01:59,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 00:01:59,437 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-19 00:01:59,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-19 00:01:59,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:59,442 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:59,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-19 00:01:59,443 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:59,444 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-19 00:01:59,447 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 00:01:59,447 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 00:01:59,447 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 00:01:59,447 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 00:01:59,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 00:01:59,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 00:01:59,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 00:01:59,449 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:59,449 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:59,451 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 00:01:59,451 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:59,451 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:59,451 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-19 00:01:59,451 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 00:01:59,451 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 00:01:59,451 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:59,451 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 00:01:59,451 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:01:59,452 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/recovered.edits] 2023-09-19 00:01:59,452 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/recovered.edits] 2023-09-19 00:01:59,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-19 00:01:59,458 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf/4b6f3a9b466447d7aca12c671967e890 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/cf/4b6f3a9b466447d7aca12c671967e890 2023-09-19 00:01:59,458 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf/68064540340c428eb7d74fbccce3613e to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/cf/68064540340c428eb7d74fbccce3613e 2023-09-19 00:01:59,462 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba/recovered.edits/9.seqid 2023-09-19 00:01:59,462 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1/recovered.edits/9.seqid 2023-09-19 00:01:59,462 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/c8bd95e3eeeefb50dd0613f5d33280ba 2023-09-19 00:01:59,463 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemState/2075436f2b68c573c181dbaa20b4dae1 2023-09-19 00:01:59,463 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-19 00:01:59,463 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-19 00:01:59,464 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-19 00:01:59,468 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309192c153afde1fb419885ea2784b34aa485 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309192c153afde1fb419885ea2784b34aa485 2023-09-19 00:01:59,469 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919effdffc368434e70acfa8852c578fd2d to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919effdffc368434e70acfa8852c578fd2d 2023-09-19 00:01:59,470 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-19 00:01:59,473 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:59,475 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-19 00:01:59,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-19 00:01:59,479 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:59,479 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-19 00:01:59,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081719479"}]},"ts":"9223372036854775807"} 2023-09-19 00:01:59,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081719479"}]},"ts":"9223372036854775807"} 2023-09-19 00:01:59,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 00:01:59,481 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c8bd95e3eeeefb50dd0613f5d33280ba, NAME => 'testtb-testExportFileSystemState,,1695081702916.c8bd95e3eeeefb50dd0613f5d33280ba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2075436f2b68c573c181dbaa20b4dae1, NAME => 'testtb-testExportFileSystemState,1,1695081702916.2075436f2b68c573c181dbaa20b4dae1.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 00:01:59,481 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-19 00:01:59,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695081719481"}]},"ts":"9223372036854775807"} 2023-09-19 00:01:59,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-19 00:01:59,486 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 00:01:59,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-09-19 00:01:59,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-19 00:01:59,554 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-19 00:01:59,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-19 00:01:59,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-19 00:01:59,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-19 00:01:59,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-19 00:01:59,599 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 756) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:34440 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:52678 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:57140 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41729 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1665866590_1 at /127.0.0.1:34424 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1665866590_1 at /127.0.0.1:52650 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 247) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8927 (was 9047) 2023-09-19 00:01:59,599 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-19 00:01:59,622 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=170, AvailableMemoryMB=8926 2023-09-19 00:01:59,623 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-19 00:01:59,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 00:01:59,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:01:59,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:01:59,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-19 00:01:59,630 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:01:59,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 00:01:59,633 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:01:59,633 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:01:59,634 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f empty. 2023-09-19 00:01:59,634 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f empty. 2023-09-19 00:01:59,634 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:01:59,634 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:01:59,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-19 00:01:59,649 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-19 00:01:59,650 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 99deb5cd50754f1a73a2cb359f688a9f, NAME => 'testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:59,651 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7f844c3e062ce0dd458a36b111f0da1f, NAME => 'testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:01:59,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:59,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 99deb5cd50754f1a73a2cb359f688a9f, disabling compactions & flushes 2023-09-19 00:01:59,669 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:01:59,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:01:59,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. after waiting 0 ms 2023-09-19 00:01:59,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:01:59,669 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:01:59,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 99deb5cd50754f1a73a2cb359f688a9f: 2023-09-19 00:01:59,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:01:59,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 7f844c3e062ce0dd458a36b111f0da1f, disabling compactions & flushes 2023-09-19 00:01:59,672 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:01:59,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:01:59,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. after waiting 0 ms 2023-09-19 00:01:59,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:01:59,672 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:01:59,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 7f844c3e062ce0dd458a36b111f0da1f: 2023-09-19 00:01:59,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:01:59,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081719676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081719676"}]},"ts":"1695081719676"} 2023-09-19 00:01:59,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081719676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081719676"}]},"ts":"1695081719676"} 2023-09-19 00:01:59,679 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 00:01:59,680 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:01:59,680 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081719680"}]},"ts":"1695081719680"} 2023-09-19 00:01:59,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-19 00:01:59,685 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:01:59,686 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:01:59,686 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:01:59,686 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:01:59,686 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:01:59,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=99deb5cd50754f1a73a2cb359f688a9f, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f844c3e062ce0dd458a36b111f0da1f, ASSIGN}] 2023-09-19 00:01:59,689 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=99deb5cd50754f1a73a2cb359f688a9f, ASSIGN 2023-09-19 00:01:59,689 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f844c3e062ce0dd458a36b111f0da1f, ASSIGN 2023-09-19 00:01:59,690 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=99deb5cd50754f1a73a2cb359f688a9f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34277,1695081676849; forceNewPlan=false, retain=false 2023-09-19 00:01:59,690 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f844c3e062ce0dd458a36b111f0da1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35543,1695081676765; forceNewPlan=false, retain=false 2023-09-19 00:01:59,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 00:01:59,841 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 00:01:59,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=99deb5cd50754f1a73a2cb359f688a9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:01:59,843 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7f844c3e062ce0dd458a36b111f0da1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:01:59,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081719843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081719843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081719843"}]},"ts":"1695081719843"} 2023-09-19 00:01:59,844 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081719843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081719843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081719843"}]},"ts":"1695081719843"} 2023-09-19 00:01:59,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 99deb5cd50754f1a73a2cb359f688a9f, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:01:59,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 7f844c3e062ce0dd458a36b111f0da1f, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:01:59,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 00:02:00,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99deb5cd50754f1a73a2cb359f688a9f, NAME => 'testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 00:02:00,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. service=AccessControlService 2023-09-19 00:02:00,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:00,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:00,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:00,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f844c3e062ce0dd458a36b111f0da1f, NAME => 'testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 00:02:00,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:00,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:00,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:00,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. service=AccessControlService 2023-09-19 00:02:00,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:00,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:00,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:00,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:00,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:00,010 INFO [StoreOpener-99deb5cd50754f1a73a2cb359f688a9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:00,011 INFO [StoreOpener-7f844c3e062ce0dd458a36b111f0da1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:00,012 DEBUG [StoreOpener-99deb5cd50754f1a73a2cb359f688a9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf 2023-09-19 00:02:00,012 DEBUG [StoreOpener-99deb5cd50754f1a73a2cb359f688a9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf 2023-09-19 00:02:00,012 DEBUG [StoreOpener-7f844c3e062ce0dd458a36b111f0da1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf 2023-09-19 00:02:00,012 DEBUG [StoreOpener-7f844c3e062ce0dd458a36b111f0da1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf 2023-09-19 00:02:00,012 INFO [StoreOpener-99deb5cd50754f1a73a2cb359f688a9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99deb5cd50754f1a73a2cb359f688a9f columnFamilyName cf 2023-09-19 00:02:00,012 INFO [StoreOpener-7f844c3e062ce0dd458a36b111f0da1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f844c3e062ce0dd458a36b111f0da1f columnFamilyName cf 2023-09-19 00:02:00,014 INFO [StoreOpener-99deb5cd50754f1a73a2cb359f688a9f-1] regionserver.HStore(310): Store=99deb5cd50754f1a73a2cb359f688a9f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:00,014 INFO [StoreOpener-7f844c3e062ce0dd458a36b111f0da1f-1] regionserver.HStore(310): Store=7f844c3e062ce0dd458a36b111f0da1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:00,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:00,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:00,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:00,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:00,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:00,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:00,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 99deb5cd50754f1a73a2cb359f688a9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73946709, jitterRate=0.10189183056354523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:00,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7f844c3e062ce0dd458a36b111f0da1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61347008, jitterRate=-0.08585834503173828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:00,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 99deb5cd50754f1a73a2cb359f688a9f: 2023-09-19 00:02:00,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7f844c3e062ce0dd458a36b111f0da1f: 2023-09-19 00:02:00,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f., pid=46, masterSystemTime=1695081719998 2023-09-19 00:02:00,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f., pid=45, masterSystemTime=1695081719997 2023-09-19 00:02:00,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:00,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:00,025 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7f844c3e062ce0dd458a36b111f0da1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,025 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081720025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081720025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081720025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081720025"}]},"ts":"1695081720025"} 2023-09-19 00:02:00,026 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=99deb5cd50754f1a73a2cb359f688a9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,026 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081720025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081720025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081720025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081720025"}]},"ts":"1695081720025"} 2023-09-19 00:02:00,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-19 00:02:00,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 7f844c3e062ce0dd458a36b111f0da1f, server=jenkins-hbase4.apache.org,35543,1695081676765 in 181 msec 2023-09-19 00:02:00,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-19 00:02:00,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 99deb5cd50754f1a73a2cb359f688a9f, server=jenkins-hbase4.apache.org,34277,1695081676849 in 183 msec 2023-09-19 00:02:00,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f844c3e062ce0dd458a36b111f0da1f, ASSIGN in 344 msec 2023-09-19 00:02:00,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-19 00:02:00,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=99deb5cd50754f1a73a2cb359f688a9f, ASSIGN in 345 msec 2023-09-19 00:02:00,034 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:02:00,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081720034"}]},"ts":"1695081720034"} 2023-09-19 00:02:00,035 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-19 00:02:00,038 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:02:00,038 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-19 00:02:00,040 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 00:02:00,042 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:00,042 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:00,042 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:00,042 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:00,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:00,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:00,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:00,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:00,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 418 msec 2023-09-19 00:02:00,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 00:02:00,235 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-19 00:02:00,238 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-19 00:02:00,238 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,239 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:00,248 DEBUG [hconnection-0x4e0a2980-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:00,252 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:00,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 00:02:00,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081720255 (current time:1695081720255). 2023-09-19 00:02:00,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:00,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x71492474 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:00,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44142373, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:00,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:00,267 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:00,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71492474 to 127.0.0.1:62806 2023-09-19 00:02:00,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x720c81db to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:00,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a5e616a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:00,277 DEBUG [hconnection-0x2fb4dce9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:00,279 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x720c81db to 127.0.0.1:62806 2023-09-19 00:02:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 00:02:00,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:00,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 00:02:00,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 00:02:00,288 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 00:02:00,289 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695082320289 2023-09-19 00:02:00,289 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-19 00:02:00,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 00:02:00,290 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:00,291 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:00,292 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 00:02:00,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 00:02:00,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-19 00:02:00,294 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 00:02:00,295 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695082320295 2023-09-19 00:02:00,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,306 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-19 00:02:00,306 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,307 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-19 00:02:00,307 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-19 00:02:00,308 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,308 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,309 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,309 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,309 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,309 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,310 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,310 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,310 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,310 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 00:02:00,311 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 00:02:00,311 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,311 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 00:02:00,311 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 00:02:00,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 00:02:00,313 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,316 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 00:02:00,316 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 00:02:00,316 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 00:02:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,320 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,320 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,320 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,320 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,321 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:00,320 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,321 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,321 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,321 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,321 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5519b3a[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-19 00:02:00,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5519b3a[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:00,325 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-19 00:02:00,325 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 00:02:00,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 00:02:00,326 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:00,327 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:00,327 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. started... 2023-09-19 00:02:00,327 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,327 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,327 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. started... 2023-09-19 00:02:00,327 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:00,327 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:00,328 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f844c3e062ce0dd458a36b111f0da1f: 2023-09-19 00:02:00,328 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 99deb5cd50754f1a73a2cb359f688a9f: 2023-09-19 00:02:00,328 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,328 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,328 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:00,329 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:00,329 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:00,329 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:00,336 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 00:02:00,336 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,336 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 00:02:00,345 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. completed. 2023-09-19 00:02:00,345 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:00,345 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:00,345 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:00,345 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,345 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 00:02:00,345 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:00,347 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 00:02:00,347 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,347 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,347 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 00:02:00,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,349 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. completed. 2023-09-19 00:02:00,349 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,349 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:00,349 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:00,349 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,349 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 00:02:00,349 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:00,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,351 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,351 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 00:02:00,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,351 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,351 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 00:02:00,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35543,1695081676765': 2023-09-19 00:02:00,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-19 00:02:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:02:00,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-19 00:02:00,358 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-19 00:02:00,358 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:00,358 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:00,358 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,358 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:00,360 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,360 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,360 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,360 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,361 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,361 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,362 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,364 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,364 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,365 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,369 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,369 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,369 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,369 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,369 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,370 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,369 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,370 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-19 00:02:00,370 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,370 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,370 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,370 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,370 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:00,372 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,372 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,373 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,373 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,373 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 00:02:00,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,391 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:00,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 00:02:00,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:02:00,392 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:02:00,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,409 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-19 00:02:00,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,410 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:00,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695081720289Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695081720384 (+95 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695081720384Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695081720385 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695081720389 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695081720402 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695081720409 (+7 ms) 2023-09-19 00:02:00,414 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 00:02:00,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 125 msec 2023-09-19 00:02:00,592 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:00,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 00:02:00,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:00,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34277] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:00,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:00,602 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-19 00:02:00,602 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,602 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:00,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 00:02:00,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081720614 (current time:1695081720614). 2023-09-19 00:02:00,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:00,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x5da180df to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:00,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ead78b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:00,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:00,630 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:00,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5da180df to 127.0.0.1:62806 2023-09-19 00:02:00,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:00,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x215012d2 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:00,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70a6c95f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:00,641 DEBUG [hconnection-0x655b174b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:00,642 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:00,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x215012d2 to 127.0.0.1:62806 2023-09-19 00:02:00,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:00,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 00:02:00,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:00,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 00:02:00,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 00:02:00,652 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 00:02:00,653 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695082320653 2023-09-19 00:02:00,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 00:02:00,653 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-19 00:02:00,655 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:00,655 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:00,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 00:02:00,657 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 00:02:00,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-19 00:02:00,659 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 00:02:00,660 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695082320660 2023-09-19 00:02:00,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-19 00:02:00,673 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-19 00:02:00,673 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,674 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-19 00:02:00,674 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-19 00:02:00,675 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,675 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,676 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,676 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,676 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,676 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,677 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,677 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,677 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,677 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 00:02:00,678 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 00:02:00,678 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 00:02:00,679 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 00:02:00,679 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 00:02:00,679 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 00:02:00,678 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 00:02:00,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 00:02:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 00:02:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 00:02:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 00:02:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 00:02:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:00,682 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 00:02:00,682 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 00:02:00,682 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 00:02:00,683 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,684 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,684 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,684 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,684 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,684 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:00,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,684 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,685 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,685 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:00,685 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,685 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-19 00:02:00,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bc43cea[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:00,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-19 00:02:00,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bc43cea[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:00,690 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-19 00:02:00,690 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,692 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 00:02:00,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,692 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 00:02:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 00:02:00,693 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,693 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 00:02:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:00,693 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:00,693 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,693 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. started... 2023-09-19 00:02:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:00,693 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. started... 2023-09-19 00:02:00,693 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7f844c3e062ce0dd458a36b111f0da1f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-19 00:02:00,694 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 99deb5cd50754f1a73a2cb359f688a9f 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-19 00:02:00,695 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 00:02:00,695 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,695 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 00:02:00,718 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919e831af307de34620ac55e2a49b61d2b4 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230919e831af307de34620ac55e2a49b61d2b4 2023-09-19 00:02:00,719 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091975cefbcc7b414203bd1a763edfe1ad15 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091975cefbcc7b414203bd1a763edfe1ad15 2023-09-19 00:02:00,733 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/.tmp/cf/023e6d2a9b124b56bdea5909573f52e0 2023-09-19 00:02:00,733 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/.tmp/cf/63fcef8121494e00a5eb1e2272682028 2023-09-19 00:02:00,743 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/.tmp/cf/63fcef8121494e00a5eb1e2272682028 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf/63fcef8121494e00a5eb1e2272682028 2023-09-19 00:02:00,743 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/.tmp/cf/023e6d2a9b124b56bdea5909573f52e0 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf/023e6d2a9b124b56bdea5909573f52e0 2023-09-19 00:02:00,748 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf/023e6d2a9b124b56bdea5909573f52e0, entries=45, sequenceid=6, filesize=12.4 K 2023-09-19 00:02:00,748 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf/63fcef8121494e00a5eb1e2272682028, entries=5, sequenceid=6, filesize=5.7 K 2023-09-19 00:02:00,749 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 99deb5cd50754f1a73a2cb359f688a9f in 55ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:00,749 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-19 00:02:00,749 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 7f844c3e062ce0dd458a36b111f0da1f in 56ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:00,749 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 99deb5cd50754f1a73a2cb359f688a9f: 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f844c3e062ce0dd458a36b111f0da1f: 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf/63fcef8121494e00a5eb1e2272682028] hfiles 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf/023e6d2a9b124b56bdea5909573f52e0] hfiles 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf/63fcef8121494e00a5eb1e2272682028 for snapshot=snaptb0-testConsecutiveExports 2023-09-19 00:02:00,751 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf/023e6d2a9b124b56bdea5909573f52e0 for snapshot=snaptb0-testConsecutiveExports 2023-09-19 00:02:00,755 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:00,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 00:02:00,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:02:00,756 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:02:00,764 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. completed. 2023-09-19 00:02:00,764 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:00,764 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. completed. 2023-09-19 00:02:00,764 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 00:02:00,764 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:00,766 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 00:02:00,766 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,766 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,766 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 00:02:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,767 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,767 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 00:02:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 00:02:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:02:00,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-19 00:02:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35543,1695081676765': 2023-09-19 00:02:00,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-19 00:02:00,775 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-19 00:02:00,775 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:00,775 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:00,776 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-19 00:02:00,776 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:00,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:00,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:00,780 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,781 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,782 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:00,784 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 00:02:00,784 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,785 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-19 00:02:00,791 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:00,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-19 00:02:00,791 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,793 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 00:02:00,793 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:00,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:00,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,793 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:00,794 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:00,794 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:00,794 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,794 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091975cefbcc7b414203bd1a763edfe1ad15, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230919e831af307de34620ac55e2a49b61d2b4] mob files 2023-09-19 00:02:00,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091975cefbcc7b414203bd1a763edfe1ad15 2023-09-19 00:02:00,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230919e831af307de34620ac55e2a49b61d2b4 2023-09-19 00:02:00,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-19 00:02:00,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-19 00:02:00,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,823 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695081720654Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695081720803 (+149 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695081720803Loading Region manifests for snaptb0-testConsecutiveExports at 1695081720803Writing data manifest for snaptb0-testConsecutiveExports at 1695081720807 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695081720814 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695081720822 (+8 ms) 2023-09-19 00:02:00,825 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 00:02:00,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 170 msec 2023-09-19 00:02:00,956 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:00,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 00:02:00,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:00,958 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958 2023-09-19 00:02:00,958 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:00,979 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:00,979 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2225aeb6, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 00:02:00,979 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-19 00:02:00,988 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 00:02:01,001 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,001 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,001 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,002 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,901 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-3546561879994829712.jar 2023-09-19 00:02:01,901 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,902 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,968 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-5491675648938591576.jar 2023-09-19 00:02:01,969 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,969 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,970 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,970 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,970 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,971 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:01,971 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 00:02:01,971 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 00:02:01,972 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 00:02:01,972 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 00:02:01,972 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 00:02:01,973 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 00:02:01,973 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 00:02:01,974 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 00:02:01,974 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 00:02:01,974 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 00:02:01,975 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:01,975 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:01,976 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:01,976 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:01,976 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:01,977 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:01,977 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:02,350 WARN [Listener at jenkins-hbase4.apache.org/39435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 00:02:02,353 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-19 00:02:02,355 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-19 00:02:03,313 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:03,313 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:03,316 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0002_000001 (auth:SIMPLE) 2023-09-19 00:02:04,107 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0003_000001 (auth:SIMPLE) 2023-09-19 00:02:04,896 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:02:07,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0003_000001 (auth:SIMPLE) 2023-09-19 00:02:10,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0003_000001 (auth:SIMPLE) 2023-09-19 00:02:12,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0003_000001 (auth:SIMPLE) 2023-09-19 00:02:13,511 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 00:02:13,511 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 00:02:13,516 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-19 00:02:13,516 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 00:02:13,517 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 00:02:13,517 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 00:02:13,520 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 00:02:13,520 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 00:02:13,520 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@739d1e7c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 00:02:13,520 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 00:02:13,520 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 00:02:13,521 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:13,543 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:13,543 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@51a30a0e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 00:02:13,543 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-19 00:02:13,555 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 00:02:13,567 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:13,567 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:13,567 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:13,568 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,444 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-8452182033949143277.jar 2023-09-19 00:02:14,445 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,445 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,512 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-2303650651241086360.jar 2023-09-19 00:02:14,512 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,513 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,513 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,514 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,515 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,515 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:14,516 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 00:02:14,516 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 00:02:14,517 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 00:02:14,517 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 00:02:14,517 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 00:02:14,518 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 00:02:14,518 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 00:02:14,518 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 00:02:14,519 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 00:02:14,519 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 00:02:14,520 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:14,520 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:14,521 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:14,521 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:14,521 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:14,522 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:14,522 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:14,903 WARN [Listener at jenkins-hbase4.apache.org/39435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 00:02:14,906 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-19 00:02:14,908 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-19 00:02:18,549 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:18,549 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:18,552 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0003_000001 (auth:SIMPLE) 2023-09-19 00:02:19,325 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0004_000001 (auth:SIMPLE) 2023-09-19 00:02:23,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0004_000001 (auth:SIMPLE) 2023-09-19 00:02:25,248 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0004_000001 (auth:SIMPLE) 2023-09-19 00:02:27,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0004_000001 (auth:SIMPLE) 2023-09-19 00:02:29,070 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 00:02:29,070 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 00:02:29,074 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-19 00:02:29,074 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 00:02:29,074 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 00:02:29,074 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 00:02:29,078 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 00:02:29,078 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 00:02:29,078 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@739d1e7c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 00:02:29,078 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 00:02:29,078 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/local-export-1695081720958/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 00:02:29,090 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-19 00:02:29,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-19 00:02:29,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:02:29,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 00:02:29,095 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081749095"}]},"ts":"1695081749095"} 2023-09-19 00:02:29,097 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-19 00:02:29,098 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-19 00:02:29,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=99deb5cd50754f1a73a2cb359f688a9f, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f844c3e062ce0dd458a36b111f0da1f, UNASSIGN}] 2023-09-19 00:02:29,101 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=99deb5cd50754f1a73a2cb359f688a9f, UNASSIGN 2023-09-19 00:02:29,101 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f844c3e062ce0dd458a36b111f0da1f, UNASSIGN 2023-09-19 00:02:29,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=99deb5cd50754f1a73a2cb359f688a9f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:29,102 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7f844c3e062ce0dd458a36b111f0da1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:29,102 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081749101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081749101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081749101"}]},"ts":"1695081749101"} 2023-09-19 00:02:29,102 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081749101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081749101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081749101"}]},"ts":"1695081749101"} 2023-09-19 00:02:29,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 99deb5cd50754f1a73a2cb359f688a9f, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:02:29,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 7f844c3e062ce0dd458a36b111f0da1f, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:29,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 00:02:29,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:29,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 99deb5cd50754f1a73a2cb359f688a9f, disabling compactions & flushes 2023-09-19 00:02:29,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:29,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:29,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. after waiting 0 ms 2023-09-19 00:02:29,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:29,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7f844c3e062ce0dd458a36b111f0da1f, disabling compactions & flushes 2023-09-19 00:02:29,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. after waiting 0 ms 2023-09-19 00:02:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:29,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:02:29,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:29,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:02:29,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f. 2023-09-19 00:02:29,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 99deb5cd50754f1a73a2cb359f688a9f: 2023-09-19 00:02:29,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:29,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f. 2023-09-19 00:02:29,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7f844c3e062ce0dd458a36b111f0da1f: 2023-09-19 00:02:29,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:29,271 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=99deb5cd50754f1a73a2cb359f688a9f, regionState=CLOSED 2023-09-19 00:02:29,271 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081749271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081749271"}]},"ts":"1695081749271"} 2023-09-19 00:02:29,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:29,272 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7f844c3e062ce0dd458a36b111f0da1f, regionState=CLOSED 2023-09-19 00:02:29,272 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695081749272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081749272"}]},"ts":"1695081749272"} 2023-09-19 00:02:29,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-19 00:02:29,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 99deb5cd50754f1a73a2cb359f688a9f, server=jenkins-hbase4.apache.org,34277,1695081676849 in 170 msec 2023-09-19 00:02:29,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-19 00:02:29,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 7f844c3e062ce0dd458a36b111f0da1f, server=jenkins-hbase4.apache.org,35543,1695081676765 in 169 msec 2023-09-19 00:02:29,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=99deb5cd50754f1a73a2cb359f688a9f, UNASSIGN in 175 msec 2023-09-19 00:02:29,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-19 00:02:29,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f844c3e062ce0dd458a36b111f0da1f, UNASSIGN in 176 msec 2023-09-19 00:02:29,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081749277"}]},"ts":"1695081749277"} 2023-09-19 00:02:29,278 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-19 00:02:29,280 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-19 00:02:29,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 190 msec 2023-09-19 00:02:29,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 00:02:29,397 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-19 00:02:29,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-19 00:02:29,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:02:29,402 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:02:29,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-19 00:02:29,402 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:02:29,406 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-19 00:02:29,410 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:29,410 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:29,411 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,411 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,411 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,411 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 00:02:29,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 00:02:29,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 00:02:29,412 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/recovered.edits] 2023-09-19 00:02:29,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 00:02:29,412 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/recovered.edits] 2023-09-19 00:02:29,413 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,413 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,414 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,413 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,413 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 00:02:29,414 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,414 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,414 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-19 00:02:29,418 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf/63fcef8121494e00a5eb1e2272682028 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/cf/63fcef8121494e00a5eb1e2272682028 2023-09-19 00:02:29,419 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf/023e6d2a9b124b56bdea5909573f52e0 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/cf/023e6d2a9b124b56bdea5909573f52e0 2023-09-19 00:02:29,422 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f/recovered.edits/9.seqid 2023-09-19 00:02:29,423 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/99deb5cd50754f1a73a2cb359f688a9f 2023-09-19 00:02:29,423 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f/recovered.edits/9.seqid 2023-09-19 00:02:29,424 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testConsecutiveExports/7f844c3e062ce0dd458a36b111f0da1f 2023-09-19 00:02:29,424 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-19 00:02:29,424 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-19 00:02:29,425 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-19 00:02:29,428 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091975cefbcc7b414203bd1a763edfe1ad15 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091975cefbcc7b414203bd1a763edfe1ad15 2023-09-19 00:02:29,429 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230919e831af307de34620ac55e2a49b61d2b4 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230919e831af307de34620ac55e2a49b61d2b4 2023-09-19 00:02:29,430 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-19 00:02:29,432 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:02:29,435 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-19 00:02:29,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-19 00:02:29,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:02:29,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-19 00:02:29,438 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081749438"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:29,438 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081749438"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:29,440 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 00:02:29,440 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 99deb5cd50754f1a73a2cb359f688a9f, NAME => 'testtb-testConsecutiveExports,,1695081719624.99deb5cd50754f1a73a2cb359f688a9f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7f844c3e062ce0dd458a36b111f0da1f, NAME => 'testtb-testConsecutiveExports,1,1695081719624.7f844c3e062ce0dd458a36b111f0da1f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 00:02:29,440 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-19 00:02:29,440 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695081749440"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:29,442 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-19 00:02:29,444 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 00:02:29,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-09-19 00:02:29,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-19 00:02:29,517 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-19 00:02:29,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-19 00:02:29,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-19 00:02:29,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-19 00:02:29,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-19 00:02:29,554 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 762), OpenFileDescriptor=894 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 254), ProcessCount=170 (was 170), AvailableMemoryMB=8804 (was 8926) 2023-09-19 00:02:29,554 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-19 00:02:29,572 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=170, AvailableMemoryMB=8804 2023-09-19 00:02:29,572 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-19 00:02:29,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 00:02:29,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:29,577 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:02:29,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-19 00:02:29,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:02:29,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 00:02:29,581 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,581 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,582 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129 empty. 2023-09-19 00:02:29,582 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7 empty. 2023-09-19 00:02:29,582 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,582 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,582 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-19 00:02:29,593 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-19 00:02:29,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 995674eedaedf895384c16c543c37129, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:29,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c52e0d553db9fcf6f688de29b06ee7e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c52e0d553db9fcf6f688de29b06ee7e7, disabling compactions & flushes 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:29,603 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 995674eedaedf895384c16c543c37129, disabling compactions & flushes 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:29,603 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. after waiting 0 ms 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. after waiting 0 ms 2023-09-19 00:02:29,603 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:29,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c52e0d553db9fcf6f688de29b06ee7e7: 2023-09-19 00:02:29,603 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:29,604 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 995674eedaedf895384c16c543c37129: 2023-09-19 00:02:29,606 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:02:29,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081749606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081749606"}]},"ts":"1695081749606"} 2023-09-19 00:02:29,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081749606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081749606"}]},"ts":"1695081749606"} 2023-09-19 00:02:29,615 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 00:02:29,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:02:29,616 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081749616"}]},"ts":"1695081749616"} 2023-09-19 00:02:29,617 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-19 00:02:29,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:02:29,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:02:29,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:02:29,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:02:29,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:02:29,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=995674eedaedf895384c16c543c37129, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c52e0d553db9fcf6f688de29b06ee7e7, ASSIGN}] 2023-09-19 00:02:29,625 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=995674eedaedf895384c16c543c37129, ASSIGN 2023-09-19 00:02:29,625 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c52e0d553db9fcf6f688de29b06ee7e7, ASSIGN 2023-09-19 00:02:29,626 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=995674eedaedf895384c16c543c37129, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39367,1695081676816; forceNewPlan=false, retain=false 2023-09-19 00:02:29,626 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c52e0d553db9fcf6f688de29b06ee7e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35543,1695081676765; forceNewPlan=false, retain=false 2023-09-19 00:02:29,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 00:02:29,776 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 00:02:29,779 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c52e0d553db9fcf6f688de29b06ee7e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:29,779 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=995674eedaedf895384c16c543c37129, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:29,779 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081749779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081749779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081749779"}]},"ts":"1695081749779"} 2023-09-19 00:02:29,779 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081749779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081749779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081749779"}]},"ts":"1695081749779"} 2023-09-19 00:02:29,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure c52e0d553db9fcf6f688de29b06ee7e7, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:29,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 995674eedaedf895384c16c543c37129, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:02:29,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 00:02:29,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:29,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c52e0d553db9fcf6f688de29b06ee7e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 00:02:29,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. service=AccessControlService 2023-09-19 00:02:29,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 995674eedaedf895384c16c543c37129, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. service=AccessControlService 2023-09-19 00:02:29,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,941 INFO [StoreOpener-c52e0d553db9fcf6f688de29b06ee7e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,942 INFO [StoreOpener-995674eedaedf895384c16c543c37129-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,943 DEBUG [StoreOpener-c52e0d553db9fcf6f688de29b06ee7e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf 2023-09-19 00:02:29,943 DEBUG [StoreOpener-c52e0d553db9fcf6f688de29b06ee7e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf 2023-09-19 00:02:29,943 DEBUG [StoreOpener-995674eedaedf895384c16c543c37129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf 2023-09-19 00:02:29,943 DEBUG [StoreOpener-995674eedaedf895384c16c543c37129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf 2023-09-19 00:02:29,944 INFO [StoreOpener-c52e0d553db9fcf6f688de29b06ee7e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c52e0d553db9fcf6f688de29b06ee7e7 columnFamilyName cf 2023-09-19 00:02:29,944 INFO [StoreOpener-995674eedaedf895384c16c543c37129-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 995674eedaedf895384c16c543c37129 columnFamilyName cf 2023-09-19 00:02:29,945 INFO [StoreOpener-995674eedaedf895384c16c543c37129-1] regionserver.HStore(310): Store=995674eedaedf895384c16c543c37129/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:29,945 INFO [StoreOpener-c52e0d553db9fcf6f688de29b06ee7e7-1] regionserver.HStore(310): Store=c52e0d553db9fcf6f688de29b06ee7e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:29,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 995674eedaedf895384c16c543c37129 2023-09-19 00:02:29,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:29,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:29,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:29,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 995674eedaedf895384c16c543c37129; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75194725, jitterRate=0.1204887181520462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:29,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c52e0d553db9fcf6f688de29b06ee7e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62955140, jitterRate=-0.06189531087875366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:29,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 995674eedaedf895384c16c543c37129: 2023-09-19 00:02:29,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c52e0d553db9fcf6f688de29b06ee7e7: 2023-09-19 00:02:29,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7., pid=60, masterSystemTime=1695081749933 2023-09-19 00:02:29,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129., pid=61, masterSystemTime=1695081749934 2023-09-19 00:02:29,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:29,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:29,956 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c52e0d553db9fcf6f688de29b06ee7e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:29,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:29,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081749956"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081749956"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081749956"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081749956"}]},"ts":"1695081749956"} 2023-09-19 00:02:29,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:29,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=995674eedaedf895384c16c543c37129, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:29,957 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081749957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081749957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081749957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081749957"}]},"ts":"1695081749957"} 2023-09-19 00:02:29,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-19 00:02:29,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure c52e0d553db9fcf6f688de29b06ee7e7, server=jenkins-hbase4.apache.org,35543,1695081676765 in 177 msec 2023-09-19 00:02:29,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-19 00:02:29,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 995674eedaedf895384c16c543c37129, server=jenkins-hbase4.apache.org,39367,1695081676816 in 176 msec 2023-09-19 00:02:29,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c52e0d553db9fcf6f688de29b06ee7e7, ASSIGN in 337 msec 2023-09-19 00:02:29,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-19 00:02:29,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=995674eedaedf895384c16c543c37129, ASSIGN in 338 msec 2023-09-19 00:02:29,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:02:29,963 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081749963"}]},"ts":"1695081749963"} 2023-09-19 00:02:29,964 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-19 00:02:29,967 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:02:29,967 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-19 00:02:29,969 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 00:02:29,970 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,970 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,970 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,970 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:29,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:29,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:29,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:29,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:29,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 398 msec 2023-09-19 00:02:30,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 00:02:30,183 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-19 00:02:30,185 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,185 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:30,187 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:30,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 00:02:30,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081750199 (current time:1695081750199). 2023-09-19 00:02:30,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:30,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x43ed6a68 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:30,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7af4c02b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:30,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:30,211 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:30,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43ed6a68 to 127.0.0.1:62806 2023-09-19 00:02:30,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:30,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x7a7b3608 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:30,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52edbd05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:30,219 DEBUG [hconnection-0xec4caeb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:30,221 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:30,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a7b3608 to 127.0.0.1:62806 2023-09-19 00:02:30,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:30,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 00:02:30,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:30,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 00:02:30,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 00:02:30,229 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 00:02:30,230 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695082350230 2023-09-19 00:02:30,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 00:02:30,231 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:30,231 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:30,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 00:02:30,232 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 00:02:30,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-19 00:02:30,234 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 00:02:30,234 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695082350234 2023-09-19 00:02:30,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,243 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-19 00:02:30,243 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,244 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-19 00:02:30,244 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-19 00:02:30,244 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,244 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,250 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,250 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,250 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,250 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,250 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,250 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,251 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,251 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,252 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,252 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 00:02:30,252 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 00:02:30,252 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,252 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,253 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 00:02:30,254 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 00:02:30,252 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,254 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 00:02:30,255 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 00:02:30,255 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 00:02:30,255 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 00:02:30,254 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 00:02:30,255 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 00:02:30,255 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 00:02:30,256 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,257 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,257 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,257 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,257 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,257 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,257 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,257 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30482106[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 00:02:30,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30482106[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:30,261 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-19 00:02:30,261 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,262 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,262 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,262 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 00:02:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,263 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:30,263 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:30,263 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. started... 2023-09-19 00:02:30,263 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,263 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:30,263 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:30,263 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:30,263 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 995674eedaedf895384c16c543c37129: 2023-09-19 00:02:30,263 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. started... 2023-09-19 00:02:30,264 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,265 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c52e0d553db9fcf6f688de29b06ee7e7: 2023-09-19 00:02:30,265 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:30,265 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:30,265 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,265 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:30,265 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:30,271 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 00:02:30,271 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,271 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 00:02:30,281 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. completed. 2023-09-19 00:02:30,281 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:30,281 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:30,281 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:30,281 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,281 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 00:02:30,281 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:30,283 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 00:02:30,283 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,283 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,283 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 00:02:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35543,1695081676765': 2023-09-19 00:02:30,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-19 00:02:30,331 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:30,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 00:02:30,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:02:30,332 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:02:30,533 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:30,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 00:02:30,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:02:30,534 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 00:02:30,682 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. completed. 2023-09-19 00:02:30,682 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:30,682 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:30,682 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:30,682 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,682 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 00:02:30,682 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:30,684 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,684 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 00:02:30,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,684 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,684 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 00:02:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:02:30,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-19 00:02:30,689 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-19 00:02:30,689 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:30,689 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:30,689 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,689 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:30,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,691 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,692 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,692 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,694 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,694 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,694 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,698 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,698 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:30,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,700 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,701 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 00:02:30,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-19 00:02:30,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,727 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695081750230Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695081750707 (+477 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695081750707Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695081750708 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695081750712 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695081750720 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695081750726 (+6 ms) 2023-09-19 00:02:30,729 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 00:02:30,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 499 msec 2023-09-19 00:02:30,834 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:30,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 00:02:30,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:30,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39367] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:30,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:30,842 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,843 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:30,843 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:30,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 00:02:30,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081750853 (current time:1695081750853). 2023-09-19 00:02:30,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:30,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x7f9d2736 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:30,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14ab3028, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:30,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:30,862 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:30,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f9d2736 to 127.0.0.1:62806 2023-09-19 00:02:30,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:30,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x7f96f28d to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:30,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6924cede, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:30,870 DEBUG [hconnection-0x244399a2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:30,872 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:30,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f96f28d to 127.0.0.1:62806 2023-09-19 00:02:30,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:30,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 00:02:30,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:30,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 00:02:30,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 00:02:30,882 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 00:02:30,883 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695082350883 2023-09-19 00:02:30,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 00:02:30,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,884 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:30,884 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:30,885 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 00:02:30,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 00:02:30,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-19 00:02:30,887 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 00:02:30,888 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695082350888 2023-09-19 00:02:30,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,896 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-19 00:02:30,896 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,897 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-19 00:02:30,897 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-19 00:02:30,898 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,898 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,899 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,899 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,899 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,899 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,899 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,899 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,900 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,901 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 00:02:30,901 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 00:02:30,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,902 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 00:02:30,902 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 00:02:30,902 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,902 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 00:02:30,903 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 00:02:30,903 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 00:02:30,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,903 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 00:02:30,903 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 00:02:30,903 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:30,903 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 00:02:30,904 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 00:02:30,904 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 00:02:30,904 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 00:02:30,905 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:30,906 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,906 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:30,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b728ba2[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 00:02:30,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b728ba2[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:30,910 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-19 00:02:30,910 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 00:02:30,912 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 00:02:30,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,912 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 00:02:30,912 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:30,913 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:30,913 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. started... 2023-09-19 00:02:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 00:02:30,913 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 995674eedaedf895384c16c543c37129 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-19 00:02:30,913 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,913 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:30,913 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:30,913 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:30,913 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. started... 2023-09-19 00:02:30,914 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c52e0d553db9fcf6f688de29b06ee7e7 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-19 00:02:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 00:02:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 00:02:30,929 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309198b4b09dc1d0a48d1bc72c4288004c43d to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309198b4b09dc1d0a48d1bc72c4288004c43d 2023-09-19 00:02:30,935 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091936846a5894c8438da7d75cc7ef130b12 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091936846a5894c8438da7d75cc7ef130b12 2023-09-19 00:02:30,940 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/.tmp/cf/af700b4dd8e442f7885810a90144ebc4 2023-09-19 00:02:30,942 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/.tmp/cf/32658648952c4acfbd927bde91bb03df 2023-09-19 00:02:30,945 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/.tmp/cf/af700b4dd8e442f7885810a90144ebc4 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf/af700b4dd8e442f7885810a90144ebc4 2023-09-19 00:02:30,947 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/.tmp/cf/32658648952c4acfbd927bde91bb03df as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf/32658648952c4acfbd927bde91bb03df 2023-09-19 00:02:30,950 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf/af700b4dd8e442f7885810a90144ebc4, entries=2, sequenceid=6, filesize=5.3 K 2023-09-19 00:02:30,951 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 995674eedaedf895384c16c543c37129 in 38ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:30,951 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-19 00:02:30,952 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 995674eedaedf895384c16c543c37129: 2023-09-19 00:02:30,952 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,952 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf/32658648952c4acfbd927bde91bb03df, entries=48, sequenceid=6, filesize=13.7 K 2023-09-19 00:02:30,952 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:30,952 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf/af700b4dd8e442f7885810a90144ebc4] hfiles 2023-09-19 00:02:30,952 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf/af700b4dd8e442f7885810a90144ebc4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,953 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for c52e0d553db9fcf6f688de29b06ee7e7 in 40ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:30,954 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c52e0d553db9fcf6f688de29b06ee7e7: 2023-09-19 00:02:30,954 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,954 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:30,955 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf/32658648952c4acfbd927bde91bb03df] hfiles 2023-09-19 00:02:30,955 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf/32658648952c4acfbd927bde91bb03df for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,967 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. completed. 2023-09-19 00:02:30,968 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 00:02:30,968 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. completed. 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:30,968 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 00:02:30,968 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:30,970 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 00:02:30,970 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,970 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,970 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 00:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 00:02:30,971 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 00:02:30,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35543,1695081676765': 2023-09-19 00:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-19 00:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:02:30,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-19 00:02:30,978 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-19 00:02:30,978 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:30,978 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:30,978 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,978 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:30,984 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:30,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:30,984 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:30,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,985 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,984 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:30,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,985 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,984 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,985 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:30,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 00:02:30,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:02:30,986 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:02:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,988 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:30,988 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,988 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,991 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,992 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,992 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,991 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:30,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:30,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:30,993 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,992 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:30,993 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:30,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:30,993 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,993 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:30,993 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:30,993 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,993 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:30,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091936846a5894c8438da7d75cc7ef130b12, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309198b4b09dc1d0a48d1bc72c4288004c43d] mob files 2023-09-19 00:02:30,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091936846a5894c8438da7d75cc7ef130b12 2023-09-19 00:02:30,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309198b4b09dc1d0a48d1bc72c4288004c43d 2023-09-19 00:02:31,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:31,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:31,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:31,017 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-19 00:02:31,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:31,018 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:31,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695081750883Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695081751000 (+117 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695081751001 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695081751001Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695081751004 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695081751010 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695081751017 (+7 ms) 2023-09-19 00:02:31,020 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 00:02:31,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 136 msec 2023-09-19 00:02:31,186 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:31,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 00:02:31,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:31,215 DEBUG [Listener at jenkins-hbase4.apache.org/39435] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 00:02:31,219 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 00:02:31,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34277] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 00:02:31,221 DEBUG [Listener at jenkins-hbase4.apache.org/39435] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 00:02:31,225 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 00:02:31,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 00:02:31,226 DEBUG [Listener at jenkins-hbase4.apache.org/39435] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 00:02:31,229 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 00:02:31,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39367] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 00:02:31,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-19 00:02:31,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:31,234 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:02:31,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-19 00:02:31,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:02:31,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 00:02:31,237 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,237 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,238 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485 empty. 2023-09-19 00:02:31,238 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba empty. 2023-09-19 00:02:31,238 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,238 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-19 00:02:31,248 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-19 00:02:31,249 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a6351a79042ebd626c6b1006ffa3d485, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:31,249 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4eca7d5052bfbe518c7c74d3938728ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a6351a79042ebd626c6b1006ffa3d485, disabling compactions & flushes 2023-09-19 00:02:31,257 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. after waiting 0 ms 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:31,257 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a6351a79042ebd626c6b1006ffa3d485: 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 4eca7d5052bfbe518c7c74d3938728ba, disabling compactions & flushes 2023-09-19 00:02:31,257 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. after waiting 0 ms 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:31,257 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:31,257 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 4eca7d5052bfbe518c7c74d3938728ba: 2023-09-19 00:02:31,259 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:02:31,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081751260"}]},"ts":"1695081751260"} 2023-09-19 00:02:31,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081751260"}]},"ts":"1695081751260"} 2023-09-19 00:02:31,262 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 00:02:31,263 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:02:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081751263"}]},"ts":"1695081751263"} 2023-09-19 00:02:31,264 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-19 00:02:31,267 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:02:31,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:02:31,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:02:31,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:02:31,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:02:31,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a6351a79042ebd626c6b1006ffa3d485, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4eca7d5052bfbe518c7c74d3938728ba, ASSIGN}] 2023-09-19 00:02:31,271 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4eca7d5052bfbe518c7c74d3938728ba, ASSIGN 2023-09-19 00:02:31,271 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a6351a79042ebd626c6b1006ffa3d485, ASSIGN 2023-09-19 00:02:31,272 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a6351a79042ebd626c6b1006ffa3d485, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35543,1695081676765; forceNewPlan=false, retain=false 2023-09-19 00:02:31,272 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4eca7d5052bfbe518c7c74d3938728ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39367,1695081676816; forceNewPlan=false, retain=false 2023-09-19 00:02:31,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 00:02:31,422 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 00:02:31,425 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4eca7d5052bfbe518c7c74d3938728ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:31,425 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a6351a79042ebd626c6b1006ffa3d485, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:31,425 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081751425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081751425"}]},"ts":"1695081751425"} 2023-09-19 00:02:31,425 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081751425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081751425"}]},"ts":"1695081751425"} 2023-09-19 00:02:31,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 4eca7d5052bfbe518c7c74d3938728ba, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:02:31,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure a6351a79042ebd626c6b1006ffa3d485, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:31,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 00:02:31,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:31,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:31,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a6351a79042ebd626c6b1006ffa3d485, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.', STARTKEY => '', ENDKEY => '2'} 2023-09-19 00:02:31,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4eca7d5052bfbe518c7c74d3938728ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.', STARTKEY => '2', ENDKEY => ''} 2023-09-19 00:02:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. service=AccessControlService 2023-09-19 00:02:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. service=AccessControlService 2023-09-19 00:02:31,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:31,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,585 INFO [StoreOpener-4eca7d5052bfbe518c7c74d3938728ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,585 INFO [StoreOpener-a6351a79042ebd626c6b1006ffa3d485-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,586 DEBUG [StoreOpener-4eca7d5052bfbe518c7c74d3938728ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf 2023-09-19 00:02:31,586 DEBUG [StoreOpener-4eca7d5052bfbe518c7c74d3938728ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf 2023-09-19 00:02:31,586 DEBUG [StoreOpener-a6351a79042ebd626c6b1006ffa3d485-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf 2023-09-19 00:02:31,587 DEBUG [StoreOpener-a6351a79042ebd626c6b1006ffa3d485-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf 2023-09-19 00:02:31,587 INFO [StoreOpener-4eca7d5052bfbe518c7c74d3938728ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4eca7d5052bfbe518c7c74d3938728ba columnFamilyName cf 2023-09-19 00:02:31,587 INFO [StoreOpener-a6351a79042ebd626c6b1006ffa3d485-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6351a79042ebd626c6b1006ffa3d485 columnFamilyName cf 2023-09-19 00:02:31,587 INFO [StoreOpener-4eca7d5052bfbe518c7c74d3938728ba-1] regionserver.HStore(310): Store=4eca7d5052bfbe518c7c74d3938728ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:31,587 INFO [StoreOpener-a6351a79042ebd626c6b1006ffa3d485-1] regionserver.HStore(310): Store=a6351a79042ebd626c6b1006ffa3d485/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:31,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:31,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:31,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:31,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4eca7d5052bfbe518c7c74d3938728ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61403807, jitterRate=-0.08501197397708893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:31,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a6351a79042ebd626c6b1006ffa3d485; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66277179, jitterRate=-0.012393072247505188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:31,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4eca7d5052bfbe518c7c74d3938728ba: 2023-09-19 00:02:31,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a6351a79042ebd626c6b1006ffa3d485: 2023-09-19 00:02:31,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485., pid=70, masterSystemTime=1695081751579 2023-09-19 00:02:31,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba., pid=69, masterSystemTime=1695081751579 2023-09-19 00:02:31,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:31,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:31,597 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a6351a79042ebd626c6b1006ffa3d485, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:31,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:31,597 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081751597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081751597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081751597"}]},"ts":"1695081751597"} 2023-09-19 00:02:31,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:31,598 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4eca7d5052bfbe518c7c74d3938728ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:31,598 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081751598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081751598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081751598"}]},"ts":"1695081751598"} 2023-09-19 00:02:31,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-19 00:02:31,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure a6351a79042ebd626c6b1006ffa3d485, server=jenkins-hbase4.apache.org,35543,1695081676765 in 171 msec 2023-09-19 00:02:31,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-19 00:02:31,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 4eca7d5052bfbe518c7c74d3938728ba, server=jenkins-hbase4.apache.org,39367,1695081676816 in 172 msec 2023-09-19 00:02:31,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a6351a79042ebd626c6b1006ffa3d485, ASSIGN in 332 msec 2023-09-19 00:02:31,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-19 00:02:31,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4eca7d5052bfbe518c7c74d3938728ba, ASSIGN in 333 msec 2023-09-19 00:02:31,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:02:31,604 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081751604"}]},"ts":"1695081751604"} 2023-09-19 00:02:31,606 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-19 00:02:31,609 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:02:31,609 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-19 00:02:31,611 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-19 00:02:31,612 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:31,612 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:31,612 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:31,612 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:31,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 382 msec 2023-09-19 00:02:31,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 00:02:31,839 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-19 00:02:31,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a6351a79042ebd626c6b1006ffa3d485, 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:31,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a6351a79042ebd626c6b1006ffa3d485, 4eca7d5052bfbe518c7c74d3938728ba], force=true 2023-09-19 00:02:31,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a6351a79042ebd626c6b1006ffa3d485, 4eca7d5052bfbe518c7c74d3938728ba], force=true 2023-09-19 00:02:31,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a6351a79042ebd626c6b1006ffa3d485, 4eca7d5052bfbe518c7c74d3938728ba], force=true 2023-09-19 00:02:31,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a6351a79042ebd626c6b1006ffa3d485, 4eca7d5052bfbe518c7c74d3938728ba], force=true 2023-09-19 00:02:31,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 00:02:31,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a6351a79042ebd626c6b1006ffa3d485, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4eca7d5052bfbe518c7c74d3938728ba, UNASSIGN}] 2023-09-19 00:02:31,894 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a6351a79042ebd626c6b1006ffa3d485, UNASSIGN 2023-09-19 00:02:31,894 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4eca7d5052bfbe518c7c74d3938728ba, UNASSIGN 2023-09-19 00:02:31,895 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a6351a79042ebd626c6b1006ffa3d485, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:31,895 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4eca7d5052bfbe518c7c74d3938728ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:31,895 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751895"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081751895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081751895"}]},"ts":"1695081751895"} 2023-09-19 00:02:31,895 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081751895"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081751895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081751895"}]},"ts":"1695081751895"} 2023-09-19 00:02:31,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure a6351a79042ebd626c6b1006ffa3d485, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:31,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 4eca7d5052bfbe518c7c74d3938728ba, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:02:31,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 00:02:32,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:32,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a6351a79042ebd626c6b1006ffa3d485, disabling compactions & flushes 2023-09-19 00:02:32,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:32,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:32,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. after waiting 0 ms 2023-09-19 00:02:32,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:32,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a6351a79042ebd626c6b1006ffa3d485 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-19 00:02:32,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:32,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4eca7d5052bfbe518c7c74d3938728ba, disabling compactions & flushes 2023-09-19 00:02:32,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:32,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:32,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. after waiting 0 ms 2023-09-19 00:02:32,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:32,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4eca7d5052bfbe518c7c74d3938728ba 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-19 00:02:32,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/.tmp/cf/96e4bc1749c342d19dbd6ba254a83512 2023-09-19 00:02:32,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/.tmp/cf/558ddb6dceba4b6ab4399d00ea7c19e3 2023-09-19 00:02:32,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/.tmp/cf/558ddb6dceba4b6ab4399d00ea7c19e3 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf/558ddb6dceba4b6ab4399d00ea7c19e3 2023-09-19 00:02:32,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/.tmp/cf/96e4bc1749c342d19dbd6ba254a83512 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf/96e4bc1749c342d19dbd6ba254a83512 2023-09-19 00:02:32,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf/96e4bc1749c342d19dbd6ba254a83512, entries=1, sequenceid=5, filesize=4.7 K 2023-09-19 00:02:32,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf/558ddb6dceba4b6ab4399d00ea7c19e3, entries=1, sequenceid=5, filesize=4.7 K 2023-09-19 00:02:32,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a6351a79042ebd626c6b1006ffa3d485 in 30ms, sequenceid=5, compaction requested=false 2023-09-19 00:02:32,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4eca7d5052bfbe518c7c74d3938728ba in 29ms, sequenceid=5, compaction requested=false 2023-09-19 00:02:32,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 00:02:32,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 00:02:32,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-19 00:02:32,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-19 00:02:32,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:32,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:32,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485. 2023-09-19 00:02:32,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a6351a79042ebd626c6b1006ffa3d485: 2023-09-19 00:02:32,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba. 2023-09-19 00:02:32,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4eca7d5052bfbe518c7c74d3938728ba: 2023-09-19 00:02:32,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:32,094 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a6351a79042ebd626c6b1006ffa3d485, regionState=CLOSED 2023-09-19 00:02:32,094 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081752094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081752094"}]},"ts":"1695081752094"} 2023-09-19 00:02:32,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:32,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4eca7d5052bfbe518c7c74d3938728ba, regionState=CLOSED 2023-09-19 00:02:32,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695081752094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081752094"}]},"ts":"1695081752094"} 2023-09-19 00:02:32,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-19 00:02:32,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure a6351a79042ebd626c6b1006ffa3d485, server=jenkins-hbase4.apache.org,35543,1695081676765 in 198 msec 2023-09-19 00:02:32,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-19 00:02:32,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 4eca7d5052bfbe518c7c74d3938728ba, server=jenkins-hbase4.apache.org,39367,1695081676816 in 199 msec 2023-09-19 00:02:32,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a6351a79042ebd626c6b1006ffa3d485, UNASSIGN in 207 msec 2023-09-19 00:02:32,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-19 00:02:32,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4eca7d5052bfbe518c7c74d3938728ba, UNASSIGN in 206 msec 2023-09-19 00:02:32,144 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-19 00:02:32,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751231.a6351a79042ebd626c6b1006ffa3d485.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:32,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695081751231.4eca7d5052bfbe518c7c74d3938728ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:32,147 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:32,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 00:02:32,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7f11b175bf053926e1c1fea0fca618c9, ASSIGN}] 2023-09-19 00:02:32,198 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7f11b175bf053926e1c1fea0fca618c9, ASSIGN 2023-09-19 00:02:32,199 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7f11b175bf053926e1c1fea0fca618c9, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35543,1695081676765; forceNewPlan=false, retain=false 2023-09-19 00:02:32,349 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 00:02:32,351 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7f11b175bf053926e1c1fea0fca618c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:32,351 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695081752351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081752351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081752351"}]},"ts":"1695081752351"} 2023-09-19 00:02:32,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 7f11b175bf053926e1c1fea0fca618c9, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 00:02:32,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:32,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f11b175bf053926e1c1fea0fca618c9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.', STARTKEY => '', ENDKEY => ''} 2023-09-19 00:02:32,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. service=AccessControlService 2023-09-19 00:02:32,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:32,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:32,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:32,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:32,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:32,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/.regioninfo 2023-09-19 00:02:32,518 INFO [StoreOpener-7f11b175bf053926e1c1fea0fca618c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:32,519 DEBUG [StoreOpener-7f11b175bf053926e1c1fea0fca618c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf 2023-09-19 00:02:32,519 DEBUG [StoreOpener-7f11b175bf053926e1c1fea0fca618c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf 2023-09-19 00:02:32,519 INFO [StoreOpener-7f11b175bf053926e1c1fea0fca618c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f11b175bf053926e1c1fea0fca618c9 columnFamilyName cf 2023-09-19 00:02:32,545 DEBUG [StoreOpener-7f11b175bf053926e1c1fea0fca618c9-1] regionserver.HStore(539): loaded hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/558ddb6dceba4b6ab4399d00ea7c19e3.4eca7d5052bfbe518c7c74d3938728ba->hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf/558ddb6dceba4b6ab4399d00ea7c19e3-top 2023-09-19 00:02:32,550 DEBUG [StoreOpener-7f11b175bf053926e1c1fea0fca618c9-1] regionserver.HStore(539): loaded hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/96e4bc1749c342d19dbd6ba254a83512.a6351a79042ebd626c6b1006ffa3d485->hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf/96e4bc1749c342d19dbd6ba254a83512-top 2023-09-19 00:02:32,551 INFO [StoreOpener-7f11b175bf053926e1c1fea0fca618c9-1] regionserver.HStore(310): Store=7f11b175bf053926e1c1fea0fca618c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:32,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:32,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:32,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:32,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7f11b175bf053926e1c1fea0fca618c9; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72257402, jitterRate=0.07671919465065002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:32,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7f11b175bf053926e1c1fea0fca618c9: 2023-09-19 00:02:32,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9., pid=77, masterSystemTime=1695081752505 2023-09-19 00:02:32,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.,because compaction is disabled. 2023-09-19 00:02:32,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:32,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:32,559 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7f11b175bf053926e1c1fea0fca618c9, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:32,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695081752559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081752559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081752559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081752559"}]},"ts":"1695081752559"} 2023-09-19 00:02:32,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-19 00:02:32,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 7f11b175bf053926e1c1fea0fca618c9, server=jenkins-hbase4.apache.org,35543,1695081676765 in 207 msec 2023-09-19 00:02:32,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-19 00:02:32,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7f11b175bf053926e1c1fea0fca618c9, ASSIGN in 365 msec 2023-09-19 00:02:32,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a6351a79042ebd626c6b1006ffa3d485, 4eca7d5052bfbe518c7c74d3938728ba], force=true in 701 msec 2023-09-19 00:02:32,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 00:02:32,978 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-19 00:02:32,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 00:02:32,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081752978 (current time:1695081752978). 2023-09-19 00:02:32,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:32,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x35b42530 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:32,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26f1dd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:32,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:32,989 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:32,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35b42530 to 127.0.0.1:62806 2023-09-19 00:02:32,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:32,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x0c1902a7 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:32,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18102bb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:32,997 DEBUG [hconnection-0x62eb04c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:33,000 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:33,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c1902a7 to 127.0.0.1:62806 2023-09-19 00:02:33,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:33,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-19 00:02:33,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:33,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 00:02:33,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 00:02:33,007 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 00:02:33,008 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695082353008 2023-09-19 00:02:33,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 00:02:33,011 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:33,011 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:33,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 00:02:33,012 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 00:02:33,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-09-19 00:02:33,014 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 00:02:33,015 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695082353015 2023-09-19 00:02:33,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,025 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 00:02:33,025 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:33,026 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-19 00:02:33,026 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-19 00:02:33,026 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,026 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,028 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:33,028 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:33,028 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:33,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:33,028 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:33,028 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:33,028 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 00:02:33,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 00:02:33,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 00:02:33,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,036 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 00:02:33,037 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 00:02:33,037 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:33,036 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 00:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 00:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 00:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:33,037 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:33,039 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 00:02:33,039 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 00:02:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 00:02:33,039 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 00:02:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 00:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 00:02:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 00:02:33,041 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,042 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,043 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:33,043 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,043 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:33,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-19 00:02:33,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22f35dbd[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:33,045 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-19 00:02:33,045 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 00:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 00:02:33,047 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,048 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:33,048 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:33,048 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. started... 2023-09-19 00:02:33,050 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f11b175bf053926e1c1fea0fca618c9: 2023-09-19 00:02:33,050 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,050 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:33,050 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/558ddb6dceba4b6ab4399d00ea7c19e3.4eca7d5052bfbe518c7c74d3938728ba->hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf/558ddb6dceba4b6ab4399d00ea7c19e3-top, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/96e4bc1749c342d19dbd6ba254a83512.a6351a79042ebd626c6b1006ffa3d485->hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf/96e4bc1749c342d19dbd6ba254a83512-top] hfiles 2023-09-19 00:02:33,050 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/558ddb6dceba4b6ab4399d00ea7c19e3.4eca7d5052bfbe518c7c74d3938728ba for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 00:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 00:02:33,051 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/96e4bc1749c342d19dbd6ba254a83512.a6351a79042ebd626c6b1006ffa3d485 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 00:02:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 00:02:33,062 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. completed. 2023-09-19 00:02:33,062 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:33,062 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:33,062 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:33,062 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,062 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 00:02:33,062 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:33,068 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 00:02:33,068 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,068 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:33,069 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 00:02:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35543,1695081676765': 2023-09-19 00:02:33,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-19 00:02:33,072 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-19 00:02:33,072 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:33,072 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:33,072 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,072 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:33,073 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,073 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,073 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:33,073 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:33,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,073 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:33,073 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,074 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:33,074 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:33,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:33,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:33,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,075 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,075 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,077 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:33,077 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,077 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:33,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:33,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:33,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:33,080 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:33,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,080 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:33,081 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:33,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:33,081 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:33,081 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,081 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,083 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:33,083 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:33,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:33,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:33,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:33,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:33,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-19 00:02:33,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,101 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695081753008Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695081753081 (+73 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695081753081Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695081753085 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695081753094 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695081753101 (+7 ms) 2023-09-19 00:02:33,104 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 00:02:33,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 93 msec 2023-09-19 00:02:33,112 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:33,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-19 00:02:33,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:33,114 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114 2023-09-19 00:02:33,114 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:33,135 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:33,135 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499030779_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,135 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-19 00:02:33,143 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:33,161 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:33,161 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:33,162 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:33,162 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,008 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0004_000001 (auth:SIMPLE) 2023-09-19 00:02:34,047 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-652446972310147392.jar 2023-09-19 00:02:34,047 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,048 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,114 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-6793507462883076477.jar 2023-09-19 00:02:34,115 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,115 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,115 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,116 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,116 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,116 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:34,117 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 00:02:34,117 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 00:02:34,118 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 00:02:34,118 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 00:02:34,118 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 00:02:34,119 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 00:02:34,119 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 00:02:34,119 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 00:02:34,120 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 00:02:34,120 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 00:02:34,121 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:34,121 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:34,122 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:34,122 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:34,122 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:34,123 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:34,123 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:34,533 WARN [Listener at jenkins-hbase4.apache.org/39435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 00:02:34,535 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-19 00:02:34,537 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-19 00:02:34,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:34,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:34,860 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:02:35,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0005_000001 (auth:SIMPLE) 2023-09-19 00:02:38,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0005_000001 (auth:SIMPLE) 2023-09-19 00:02:40,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0005_000001 (auth:SIMPLE) 2023-09-19 00:02:43,261 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0005_000001 (auth:SIMPLE) 2023-09-19 00:02:44,690 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 00:02:44,691 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 00:02:44,700 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:44,700 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 00:02:44,701 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 00:02:44,701 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:44,701 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-19 00:02:44,701 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-19 00:02:44,701 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:44,702 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-19 00:02:44,702 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081753114/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-19 00:02:44,708 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:44,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:44,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:44,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 00:02:44,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081764713"}]},"ts":"1695081764713"} 2023-09-19 00:02:44,714 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-19 00:02:44,716 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-19 00:02:44,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7f11b175bf053926e1c1fea0fca618c9, UNASSIGN}] 2023-09-19 00:02:44,718 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7f11b175bf053926e1c1fea0fca618c9, UNASSIGN 2023-09-19 00:02:44,719 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7f11b175bf053926e1c1fea0fca618c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:44,719 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695081764719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081764719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081764719"}]},"ts":"1695081764719"} 2023-09-19 00:02:44,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 7f11b175bf053926e1c1fea0fca618c9, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:44,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 00:02:44,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:44,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7f11b175bf053926e1c1fea0fca618c9, disabling compactions & flushes 2023-09-19 00:02:44,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:44,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:44,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. after waiting 0 ms 2023-09-19 00:02:44,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:44,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-19 00:02:44,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:44,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9. 2023-09-19 00:02:44,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7f11b175bf053926e1c1fea0fca618c9: 2023-09-19 00:02:44,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:44,889 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7f11b175bf053926e1c1fea0fca618c9, regionState=CLOSED 2023-09-19 00:02:44,889 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695081764888"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081764888"}]},"ts":"1695081764888"} 2023-09-19 00:02:44,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-19 00:02:44,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 7f11b175bf053926e1c1fea0fca618c9, server=jenkins-hbase4.apache.org,35543,1695081676765 in 170 msec 2023-09-19 00:02:44,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-19 00:02:44,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7f11b175bf053926e1c1fea0fca618c9, UNASSIGN in 175 msec 2023-09-19 00:02:44,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081764893"}]},"ts":"1695081764893"} 2023-09-19 00:02:44,895 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-19 00:02:44,896 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-19 00:02:44,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-09-19 00:02:45,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 00:02:45,015 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-19 00:02:45,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,020 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,021 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,024 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:45,024 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:45,024 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:45,025 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,025 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,025 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,025 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 00:02:45,026 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 00:02:45,026 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 00:02:45,026 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 00:02:45,026 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/recovered.edits] 2023-09-19 00:02:45,026 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/recovered.edits] 2023-09-19 00:02:45,026 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/recovered.edits] 2023-09-19 00:02:45,026 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,026 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,027 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,026 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,027 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,027 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,026 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,027 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,027 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:45,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-19 00:02:45,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:45,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:45,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:45,031 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/558ddb6dceba4b6ab4399d00ea7c19e3.4eca7d5052bfbe518c7c74d3938728ba to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/558ddb6dceba4b6ab4399d00ea7c19e3.4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:45,031 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf/558ddb6dceba4b6ab4399d00ea7c19e3 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/cf/558ddb6dceba4b6ab4399d00ea7c19e3 2023-09-19 00:02:45,031 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf/96e4bc1749c342d19dbd6ba254a83512 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/cf/96e4bc1749c342d19dbd6ba254a83512 2023-09-19 00:02:45,033 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/96e4bc1749c342d19dbd6ba254a83512.a6351a79042ebd626c6b1006ffa3d485 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/cf/96e4bc1749c342d19dbd6ba254a83512.a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:45,035 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/recovered.edits/8.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba/recovered.edits/8.seqid 2023-09-19 00:02:45,035 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/recovered.edits/8.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485/recovered.edits/8.seqid 2023-09-19 00:02:45,036 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4eca7d5052bfbe518c7c74d3938728ba 2023-09-19 00:02:45,036 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a6351a79042ebd626c6b1006ffa3d485 2023-09-19 00:02:45,036 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/recovered.edits/12.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9/recovered.edits/12.seqid 2023-09-19 00:02:45,037 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7f11b175bf053926e1c1fea0fca618c9 2023-09-19 00:02:45,037 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-19 00:02:45,039 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,041 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-19 00:02:45,042 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-19 00:02:45,043 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,043 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-19 00:02:45,043 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081765043"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:45,045 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-19 00:02:45,045 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7f11b175bf053926e1c1fea0fca618c9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695081751232.7f11b175bf053926e1c1fea0fca618c9.', STARTKEY => '', ENDKEY => ''}] 2023-09-19 00:02:45,045 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-19 00:02:45,045 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695081765045"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:45,046 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-19 00:02:45,048 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 32 msec 2023-09-19 00:02:45,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-19 00:02:45,129 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-19 00:02:45,130 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 00:02:45,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081765134"}]},"ts":"1695081765134"} 2023-09-19 00:02:45,136 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-19 00:02:45,137 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-19 00:02:45,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=995674eedaedf895384c16c543c37129, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c52e0d553db9fcf6f688de29b06ee7e7, UNASSIGN}] 2023-09-19 00:02:45,140 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=995674eedaedf895384c16c543c37129, UNASSIGN 2023-09-19 00:02:45,140 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c52e0d553db9fcf6f688de29b06ee7e7, UNASSIGN 2023-09-19 00:02:45,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=995674eedaedf895384c16c543c37129, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:45,141 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c52e0d553db9fcf6f688de29b06ee7e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:45,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081765141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081765141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081765141"}]},"ts":"1695081765141"} 2023-09-19 00:02:45,141 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081765141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081765141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081765141"}]},"ts":"1695081765141"} 2023-09-19 00:02:45,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 995674eedaedf895384c16c543c37129, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:02:45,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure c52e0d553db9fcf6f688de29b06ee7e7, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:45,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 00:02:45,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 995674eedaedf895384c16c543c37129 2023-09-19 00:02:45,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 995674eedaedf895384c16c543c37129, disabling compactions & flushes 2023-09-19 00:02:45,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:45,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:45,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. after waiting 0 ms 2023-09-19 00:02:45,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:45,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:45,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c52e0d553db9fcf6f688de29b06ee7e7, disabling compactions & flushes 2023-09-19 00:02:45,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:45,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:45,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. after waiting 0 ms 2023-09-19 00:02:45,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:45,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:02:45,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:02:45,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:45,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:45,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7. 2023-09-19 00:02:45,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129. 2023-09-19 00:02:45,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c52e0d553db9fcf6f688de29b06ee7e7: 2023-09-19 00:02:45,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 995674eedaedf895384c16c543c37129: 2023-09-19 00:02:45,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:45,310 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c52e0d553db9fcf6f688de29b06ee7e7, regionState=CLOSED 2023-09-19 00:02:45,310 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081765310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081765310"}]},"ts":"1695081765310"} 2023-09-19 00:02:45,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 995674eedaedf895384c16c543c37129 2023-09-19 00:02:45,311 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=995674eedaedf895384c16c543c37129, regionState=CLOSED 2023-09-19 00:02:45,311 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695081765311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081765311"}]},"ts":"1695081765311"} 2023-09-19 00:02:45,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-19 00:02:45,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure c52e0d553db9fcf6f688de29b06ee7e7, server=jenkins-hbase4.apache.org,35543,1695081676765 in 167 msec 2023-09-19 00:02:45,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-19 00:02:45,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 995674eedaedf895384c16c543c37129, server=jenkins-hbase4.apache.org,39367,1695081676816 in 169 msec 2023-09-19 00:02:45,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c52e0d553db9fcf6f688de29b06ee7e7, UNASSIGN in 175 msec 2023-09-19 00:02:45,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-19 00:02:45,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=995674eedaedf895384c16c543c37129, UNASSIGN in 175 msec 2023-09-19 00:02:45,315 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081765315"}]},"ts":"1695081765315"} 2023-09-19 00:02:45,316 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-19 00:02:45,319 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-19 00:02:45,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-09-19 00:02:45,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 00:02:45,437 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-19 00:02:45,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,441 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,441 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,464 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,470 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,470 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,470 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,471 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 00:02:45,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 00:02:45,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 00:02:45,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 00:02:45,472 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129 2023-09-19 00:02:45,472 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:45,472 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,472 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,472 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,472 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,472 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,473 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,473 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,473 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:45,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-19 00:02:45,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/recovered.edits] 2023-09-19 00:02:45,474 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/recovered.edits] 2023-09-19 00:02:45,478 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf/af700b4dd8e442f7885810a90144ebc4 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/cf/af700b4dd8e442f7885810a90144ebc4 2023-09-19 00:02:45,478 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf/32658648952c4acfbd927bde91bb03df to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/cf/32658648952c4acfbd927bde91bb03df 2023-09-19 00:02:45,481 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129/recovered.edits/9.seqid 2023-09-19 00:02:45,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7/recovered.edits/9.seqid 2023-09-19 00:02:45,481 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/995674eedaedf895384c16c543c37129 2023-09-19 00:02:45,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c52e0d553db9fcf6f688de29b06ee7e7 2023-09-19 00:02:45,481 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-19 00:02:45,482 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-19 00:02:45,483 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-19 00:02:45,485 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091936846a5894c8438da7d75cc7ef130b12 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091936846a5894c8438da7d75cc7ef130b12 2023-09-19 00:02:45,487 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309198b4b09dc1d0a48d1bc72c4288004c43d to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309198b4b09dc1d0a48d1bc72c4288004c43d 2023-09-19 00:02:45,487 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-19 00:02:45,489 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,491 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-19 00:02:45,493 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-19 00:02:45,494 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,494 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-19 00:02:45,494 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081765494"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:45,494 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081765494"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:45,496 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 00:02:45,496 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 995674eedaedf895384c16c543c37129, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695081749574.995674eedaedf895384c16c543c37129.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c52e0d553db9fcf6f688de29b06ee7e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695081749574.c52e0d553db9fcf6f688de29b06ee7e7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 00:02:45,496 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-19 00:02:45,496 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695081765496"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:45,497 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-19 00:02:45,500 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 62 msec 2023-09-19 00:02:45,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-19 00:02:45,575 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-19 00:02:45,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-19 00:02:45,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-19 00:02:45,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 00:02:45,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-19 00:02:45,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 00:02:45,613 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 749) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:59652 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:50006 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:38563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:45456 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-114139360_1 at /127.0.0.1:59628 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-114139360_1 at /127.0.0.1:49998 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=174 (was 197), ProcessCount=170 (was 170), AvailableMemoryMB=8747 (was 8804) 2023-09-19 00:02:45,613 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-19 00:02:45,632 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=170, AvailableMemoryMB=8746 2023-09-19 00:02:45,633 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-19 00:02:45,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 00:02:45,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:45,637 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:02:45,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-19 00:02:45,638 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:02:45,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 00:02:45,640 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,640 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,640 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81 empty. 2023-09-19 00:02:45,640 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592 empty. 2023-09-19 00:02:45,641 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,641 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,641 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-19 00:02:45,650 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-19 00:02:45,651 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f4802616414083297767c7aed6ceea81, NAME => 'testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:45,651 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d06eb823a7f0da185f9a523bbd24a592, NAME => 'testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:45,658 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d06eb823a7f0da185f9a523bbd24a592, disabling compactions & flushes 2023-09-19 00:02:45,659 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. after waiting 0 ms 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:45,659 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d06eb823a7f0da185f9a523bbd24a592: 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f4802616414083297767c7aed6ceea81, disabling compactions & flushes 2023-09-19 00:02:45,659 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. after waiting 0 ms 2023-09-19 00:02:45,659 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:45,659 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:45,660 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f4802616414083297767c7aed6ceea81: 2023-09-19 00:02:45,661 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:02:45,662 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081765662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081765662"}]},"ts":"1695081765662"} 2023-09-19 00:02:45,662 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081765662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081765662"}]},"ts":"1695081765662"} 2023-09-19 00:02:45,664 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 00:02:45,665 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:02:45,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081765665"}]},"ts":"1695081765665"} 2023-09-19 00:02:45,666 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-19 00:02:45,669 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:02:45,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:02:45,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:02:45,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:02:45,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:02:45,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f4802616414083297767c7aed6ceea81, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d06eb823a7f0da185f9a523bbd24a592, ASSIGN}] 2023-09-19 00:02:45,673 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f4802616414083297767c7aed6ceea81, ASSIGN 2023-09-19 00:02:45,673 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d06eb823a7f0da185f9a523bbd24a592, ASSIGN 2023-09-19 00:02:45,673 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d06eb823a7f0da185f9a523bbd24a592, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39367,1695081676816; forceNewPlan=false, retain=false 2023-09-19 00:02:45,673 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f4802616414083297767c7aed6ceea81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34277,1695081676849; forceNewPlan=false, retain=false 2023-09-19 00:02:45,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 00:02:45,824 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 00:02:45,826 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f4802616414083297767c7aed6ceea81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:45,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d06eb823a7f0da185f9a523bbd24a592, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:45,826 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081765826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081765826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081765826"}]},"ts":"1695081765826"} 2023-09-19 00:02:45,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081765826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081765826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081765826"}]},"ts":"1695081765826"} 2023-09-19 00:02:45,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure f4802616414083297767c7aed6ceea81, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:02:45,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure d06eb823a7f0da185f9a523bbd24a592, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:02:45,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 00:02:45,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4802616414083297767c7aed6ceea81, NAME => 'testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. service=AccessControlService 2023-09-19 00:02:45,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:45,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d06eb823a7f0da185f9a523bbd24a592, NAME => 'testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. service=AccessControlService 2023-09-19 00:02:45,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:45,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:45,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,988 INFO [StoreOpener-f4802616414083297767c7aed6ceea81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,988 INFO [StoreOpener-d06eb823a7f0da185f9a523bbd24a592-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,989 DEBUG [StoreOpener-f4802616414083297767c7aed6ceea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf 2023-09-19 00:02:45,989 DEBUG [StoreOpener-d06eb823a7f0da185f9a523bbd24a592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf 2023-09-19 00:02:45,989 DEBUG [StoreOpener-d06eb823a7f0da185f9a523bbd24a592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf 2023-09-19 00:02:45,989 DEBUG [StoreOpener-f4802616414083297767c7aed6ceea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf 2023-09-19 00:02:45,990 INFO [StoreOpener-d06eb823a7f0da185f9a523bbd24a592-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d06eb823a7f0da185f9a523bbd24a592 columnFamilyName cf 2023-09-19 00:02:45,990 INFO [StoreOpener-f4802616414083297767c7aed6ceea81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4802616414083297767c7aed6ceea81 columnFamilyName cf 2023-09-19 00:02:45,991 INFO [StoreOpener-d06eb823a7f0da185f9a523bbd24a592-1] regionserver.HStore(310): Store=d06eb823a7f0da185f9a523bbd24a592/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:45,991 INFO [StoreOpener-f4802616414083297767c7aed6ceea81-1] regionserver.HStore(310): Store=f4802616414083297767c7aed6ceea81/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:45,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:45,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4802616414083297767c7aed6ceea81 2023-09-19 00:02:45,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:45,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d06eb823a7f0da185f9a523bbd24a592; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74765343, jitterRate=0.11409042775630951}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:45,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:45,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d06eb823a7f0da185f9a523bbd24a592: 2023-09-19 00:02:45,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4802616414083297767c7aed6ceea81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63091764, jitterRate=-0.05985945463180542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:45,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4802616414083297767c7aed6ceea81: 2023-09-19 00:02:45,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592., pid=94, masterSystemTime=1695081765982 2023-09-19 00:02:45,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81., pid=93, masterSystemTime=1695081765979 2023-09-19 00:02:46,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:46,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:46,001 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d06eb823a7f0da185f9a523bbd24a592, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,001 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081766001"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081766001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081766001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081766001"}]},"ts":"1695081766001"} 2023-09-19 00:02:46,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,001 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f4802616414083297767c7aed6ceea81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081766001"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081766001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081766001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081766001"}]},"ts":"1695081766001"} 2023-09-19 00:02:46,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-19 00:02:46,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure d06eb823a7f0da185f9a523bbd24a592, server=jenkins-hbase4.apache.org,39367,1695081676816 in 173 msec 2023-09-19 00:02:46,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-19 00:02:46,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure f4802616414083297767c7aed6ceea81, server=jenkins-hbase4.apache.org,34277,1695081676849 in 175 msec 2023-09-19 00:02:46,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d06eb823a7f0da185f9a523bbd24a592, ASSIGN in 333 msec 2023-09-19 00:02:46,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-19 00:02:46,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f4802616414083297767c7aed6ceea81, ASSIGN in 334 msec 2023-09-19 00:02:46,006 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:02:46,006 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081766006"}]},"ts":"1695081766006"} 2023-09-19 00:02:46,007 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-19 00:02:46,009 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:02:46,010 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-19 00:02:46,011 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 00:02:46,014 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:46,014 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:46,014 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:46,014 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:46,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:46,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:46,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:46,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:46,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 381 msec 2023-09-19 00:02:46,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 00:02:46,242 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-19 00:02:46,244 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-19 00:02:46,244 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,246 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:46,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:02:46,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081766257 (current time:1695081766257). 2023-09-19 00:02:46,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:46,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x1c87adb0 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:46,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f2dd1e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:46,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:46,272 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:46,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c87adb0 to 127.0.0.1:62806 2023-09-19 00:02:46,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:46,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x5fe4d5f1 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:46,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e2f0990, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:46,281 DEBUG [hconnection-0xf7c4540-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:46,282 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:46,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fe4d5f1 to 127.0.0.1:62806 2023-09-19 00:02:46,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:46,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 00:02:46,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:46,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:02:46,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:02:46,290 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:02:46,291 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695082366291 2023-09-19 00:02:46,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:02:46,291 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-19 00:02:46,292 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:46,292 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:46,293 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:02:46,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 00:02:46,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-19 00:02:46,297 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 00:02:46,297 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695082366297 2023-09-19 00:02:46,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,306 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-19 00:02:46,306 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,308 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-19 00:02:46,308 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-19 00:02:46,308 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,308 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,314 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,314 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,314 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,314 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,314 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,314 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,315 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,315 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,316 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 00:02:46,316 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 00:02:46,316 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,317 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 00:02:46,317 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 00:02:46,317 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,316 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,318 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 00:02:46,319 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 00:02:46,319 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 00:02:46,319 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 00:02:46,319 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 00:02:46,317 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 00:02:46,319 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 00:02:46,319 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 00:02:46,321 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,321 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,322 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,322 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,322 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,322 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:46,322 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,322 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,322 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:46,323 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,323 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:46,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 00:02:46,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@788a0665[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:46,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 00:02:46,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@788a0665[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:46,327 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 00:02:46,327 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:02:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,329 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:02:46,329 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,329 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:46,329 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:02:46,329 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. started... 2023-09-19 00:02:46,329 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:46,329 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 00:02:46,330 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:46,330 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:46,331 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,331 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:46,330 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:46,331 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,331 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d06eb823a7f0da185f9a523bbd24a592: 2023-09-19 00:02:46,330 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:46,331 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. started... 2023-09-19 00:02:46,331 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,331 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:46,331 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:46,331 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4802616414083297767c7aed6ceea81: 2023-09-19 00:02:46,332 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,332 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:46,332 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:46,333 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 00:02:46,333 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,333 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 00:02:46,340 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. completed. 2023-09-19 00:02:46,340 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. completed. 2023-09-19 00:02:46,340 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:46,340 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 00:02:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 00:02:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:46,342 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,342 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 00:02:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,342 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,342 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,342 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 00:02:46,342 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 00:02:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 00:02:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:02:46,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 00:02:46,350 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-19 00:02:46,350 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:46,350 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:46,350 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,350 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:46,352 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,352 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,353 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,352 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,353 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,353 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,355 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,356 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,356 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,359 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,361 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-19 00:02:46,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:46,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,359 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,361 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 00:02:46,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-19 00:02:46,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,391 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695081766291Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695081766368 (+77 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695081766368Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695081766368Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695081766372 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695081766385 (+13 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695081766391 (+6 ms) 2023-09-19 00:02:46,393 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:46,395 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 00:02:46,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:02:46,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:46,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 103 msec 2023-09-19 00:02:46,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34277] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:46,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39367] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:46,402 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-19 00:02:46,402 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,402 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:46,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:02:46,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081766411 (current time:1695081766411). 2023-09-19 00:02:46,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:46,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x57de6ae4 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a65631a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:46,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:46,422 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:46,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57de6ae4 to 127.0.0.1:62806 2023-09-19 00:02:46,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:46,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x53a33bc8 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:46,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@770ef212, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:46,430 DEBUG [hconnection-0x6662325a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:46,432 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:46,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53a33bc8 to 127.0.0.1:62806 2023-09-19 00:02:46,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:46,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 00:02:46,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:46,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:02:46,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:02:46,440 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:02:46,441 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695082366441 2023-09-19 00:02:46,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 00:02:46,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-19 00:02:46,442 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:46,442 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:46,443 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 00:02:46,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 00:02:46,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-19 00:02:46,445 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 00:02:46,445 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695082366445 2023-09-19 00:02:46,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,457 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-19 00:02:46,457 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,458 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-19 00:02:46,458 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-19 00:02:46,459 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,459 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,460 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,460 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,460 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,460 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,460 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,461 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,461 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,461 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:46,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 00:02:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 00:02:46,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 00:02:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,465 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 00:02:46,465 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 00:02:46,463 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 00:02:46,465 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 00:02:46,465 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 00:02:46,465 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 00:02:46,465 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 00:02:46,465 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:46,468 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 00:02:46,468 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 00:02:46,468 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 00:02:46,469 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,469 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,469 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,470 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,470 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,470 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,470 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,470 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:46,470 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:46,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,470 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,470 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bb4863[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 00:02:46,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bb4863[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:46,474 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 00:02:46,474 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,479 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:02:46,479 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:02:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 00:02:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:46,479 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 00:02:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:46,480 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,480 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:46,480 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,480 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:46,480 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. started... 2023-09-19 00:02:46,480 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. started... 2023-09-19 00:02:46,480 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f4802616414083297767c7aed6ceea81 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-19 00:02:46,480 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d06eb823a7f0da185f9a523bbd24a592 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-19 00:02:46,481 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 00:02:46,481 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,481 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 00:02:46,501 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309195c5f6b8e73844d85989f3d332ff4c1cc to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309195c5f6b8e73844d85989f3d332ff4c1cc 2023-09-19 00:02:46,512 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/.tmp/cf/b51ee6b734b1484f838cef8805c3702a 2023-09-19 00:02:46,514 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309198fcc7408cd004a7dad03e58186753bb2 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309198fcc7408cd004a7dad03e58186753bb2 2023-09-19 00:02:46,518 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/.tmp/cf/b51ee6b734b1484f838cef8805c3702a as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf/b51ee6b734b1484f838cef8805c3702a 2023-09-19 00:02:46,521 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/.tmp/cf/49ea3a83b56b4b6e8a29c8fd3c705eac 2023-09-19 00:02:46,523 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf/b51ee6b734b1484f838cef8805c3702a, entries=45, sequenceid=6, filesize=12.7 K 2023-09-19 00:02:46,524 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for d06eb823a7f0da185f9a523bbd24a592 in 44ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:46,524 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-19 00:02:46,524 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d06eb823a7f0da185f9a523bbd24a592: 2023-09-19 00:02:46,524 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,526 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:46,527 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf/b51ee6b734b1484f838cef8805c3702a] hfiles 2023-09-19 00:02:46,527 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf/b51ee6b734b1484f838cef8805c3702a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,529 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/.tmp/cf/49ea3a83b56b4b6e8a29c8fd3c705eac as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf/49ea3a83b56b4b6e8a29c8fd3c705eac 2023-09-19 00:02:46,537 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. completed. 2023-09-19 00:02:46,537 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:46,537 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:46,537 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:46,537 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,537 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 00:02:46,537 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:46,539 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 00:02:46,539 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,539 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,539 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf/49ea3a83b56b4b6e8a29c8fd3c705eac, entries=5, sequenceid=6, filesize=5.8 K 2023-09-19 00:02:46,539 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 00:02:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,542 INFO [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for f4802616414083297767c7aed6ceea81 in 62ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:46,543 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:46,543 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4802616414083297767c7aed6ceea81: 2023-09-19 00:02:46,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,543 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,543 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:46,543 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf/49ea3a83b56b4b6e8a29c8fd3c705eac] hfiles 2023-09-19 00:02:46,543 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf/49ea3a83b56b4b6e8a29c8fd3c705eac for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:02:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:02:46,544 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:02:46,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:02:46,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 00:02:46,551 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. completed. 2023-09-19 00:02:46,551 DEBUG [rs(jenkins-hbase4.apache.org,34277,1695081676849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 00:02:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 00:02:46,553 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 00:02:46,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34277,1695081676849': 2023-09-19 00:02:46,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 00:02:46,559 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-19 00:02:46,559 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:46,559 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:46,559 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,559 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:46,561 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:46,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,562 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,563 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,563 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,565 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:46,565 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,565 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:46,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:46,569 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,568 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:46,568 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:46,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-19 00:02:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:46,569 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:46,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:46,570 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,571 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:46,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:46,571 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:46,571 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,571 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309195c5f6b8e73844d85989f3d332ff4c1cc, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309198fcc7408cd004a7dad03e58186753bb2] mob files 2023-09-19 00:02:46,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309195c5f6b8e73844d85989f3d332ff4c1cc 2023-09-19 00:02:46,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309198fcc7408cd004a7dad03e58186753bb2 2023-09-19 00:02:46,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-19 00:02:46,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,605 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695081766441Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695081766581 (+140 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695081766581Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695081766581Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695081766589 (+8 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695081766597 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695081766604 (+7 ms) 2023-09-19 00:02:46,610 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 00:02:46,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 168 msec 2023-09-19 00:02:46,744 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:46,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 00:02:46,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:46,746 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746 2023-09-19 00:02:46,746 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:46,767 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:46,767 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1675504282_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,767 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-19 00:02:46,772 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:46,788 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:46,788 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:46,789 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:46,789 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,661 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-8057573961387270367.jar 2023-09-19 00:02:47,662 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,662 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,728 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-5563562009612146392.jar 2023-09-19 00:02:47,729 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,729 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,730 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,730 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,730 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,731 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:47,731 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 00:02:47,731 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 00:02:47,732 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 00:02:47,732 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 00:02:47,732 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 00:02:47,733 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 00:02:47,733 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 00:02:47,733 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 00:02:47,734 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 00:02:47,734 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 00:02:47,735 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:47,735 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:47,736 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:47,736 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:47,736 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:47,736 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:47,737 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:48,088 WARN [Listener at jenkins-hbase4.apache.org/39435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 00:02:48,090 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-19 00:02:49,432 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:49,432 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:02:49,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0005_000001 (auth:SIMPLE) 2023-09-19 00:02:49,569 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0006_000001 (auth:SIMPLE) 2023-09-19 00:02:50,472 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:02:53,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0006_000001 (auth:SIMPLE) 2023-09-19 00:02:56,426 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 00:02:56,426 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 00:02:56,432 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:56,432 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 00:02:56,432 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 00:02:56,432 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:56,433 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-19 00:02:56,433 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-19 00:02:56,433 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:56,433 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-19 00:02:56,433 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081766746/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-19 00:02:56,440 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 00:02:56,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081776444"}]},"ts":"1695081776444"} 2023-09-19 00:02:56,446 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-19 00:02:56,447 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-19 00:02:56,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f4802616414083297767c7aed6ceea81, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d06eb823a7f0da185f9a523bbd24a592, UNASSIGN}] 2023-09-19 00:02:56,450 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f4802616414083297767c7aed6ceea81, UNASSIGN 2023-09-19 00:02:56,450 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d06eb823a7f0da185f9a523bbd24a592, UNASSIGN 2023-09-19 00:02:56,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d06eb823a7f0da185f9a523bbd24a592, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:56,451 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f4802616414083297767c7aed6ceea81, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:56,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081776451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081776451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081776451"}]},"ts":"1695081776451"} 2023-09-19 00:02:56,451 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081776451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081776451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081776451"}]},"ts":"1695081776451"} 2023-09-19 00:02:56,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure d06eb823a7f0da185f9a523bbd24a592, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:02:56,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure f4802616414083297767c7aed6ceea81, server=jenkins-hbase4.apache.org,34277,1695081676849}] 2023-09-19 00:02:56,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 00:02:56,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:56,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d06eb823a7f0da185f9a523bbd24a592, disabling compactions & flushes 2023-09-19 00:02:56,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:56,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:56,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. after waiting 0 ms 2023-09-19 00:02:56,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:56,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f4802616414083297767c7aed6ceea81 2023-09-19 00:02:56,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4802616414083297767c7aed6ceea81, disabling compactions & flushes 2023-09-19 00:02:56,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:56,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:56,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. after waiting 0 ms 2023-09-19 00:02:56,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:56,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:02:56,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:02:56,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:56,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592. 2023-09-19 00:02:56,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d06eb823a7f0da185f9a523bbd24a592: 2023-09-19 00:02:56,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:02:56,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81. 2023-09-19 00:02:56,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4802616414083297767c7aed6ceea81: 2023-09-19 00:02:56,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:56,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d06eb823a7f0da185f9a523bbd24a592, regionState=CLOSED 2023-09-19 00:02:56,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081776620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081776620"}]},"ts":"1695081776620"} 2023-09-19 00:02:56,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f4802616414083297767c7aed6ceea81 2023-09-19 00:02:56,620 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f4802616414083297767c7aed6ceea81, regionState=CLOSED 2023-09-19 00:02:56,620 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695081776620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081776620"}]},"ts":"1695081776620"} 2023-09-19 00:02:56,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-19 00:02:56,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure d06eb823a7f0da185f9a523bbd24a592, server=jenkins-hbase4.apache.org,39367,1695081676816 in 168 msec 2023-09-19 00:02:56,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-19 00:02:56,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure f4802616414083297767c7aed6ceea81, server=jenkins-hbase4.apache.org,34277,1695081676849 in 169 msec 2023-09-19 00:02:56,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d06eb823a7f0da185f9a523bbd24a592, UNASSIGN in 176 msec 2023-09-19 00:02:56,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-19 00:02:56,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f4802616414083297767c7aed6ceea81, UNASSIGN in 176 msec 2023-09-19 00:02:56,626 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081776626"}]},"ts":"1695081776626"} 2023-09-19 00:02:56,627 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-19 00:02:56,630 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-19 00:02:56,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 190 msec 2023-09-19 00:02:56,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 00:02:56,747 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-19 00:02:56,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,752 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,752 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,754 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,757 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,757 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,757 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,757 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81 2023-09-19 00:02:56,757 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:56,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 00:02:56,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 00:02:56,758 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 00:02:56,759 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:56,759 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,759 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,759 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:56,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-09-19 00:02:56,759 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,759 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:56,759 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:56,759 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 00:02:56,760 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/recovered.edits] 2023-09-19 00:02:56,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-19 00:02:56,761 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/recovered.edits] 2023-09-19 00:02:56,765 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf/49ea3a83b56b4b6e8a29c8fd3c705eac to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/cf/49ea3a83b56b4b6e8a29c8fd3c705eac 2023-09-19 00:02:56,765 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf/b51ee6b734b1484f838cef8805c3702a to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/cf/b51ee6b734b1484f838cef8805c3702a 2023-09-19 00:02:56,769 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81/recovered.edits/9.seqid 2023-09-19 00:02:56,769 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592/recovered.edits/9.seqid 2023-09-19 00:02:56,769 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/f4802616414083297767c7aed6ceea81 2023-09-19 00:02:56,769 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testEmptyExportFileSystemState/d06eb823a7f0da185f9a523bbd24a592 2023-09-19 00:02:56,770 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-19 00:02:56,770 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-19 00:02:56,771 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-19 00:02:56,774 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309195c5f6b8e73844d85989f3d332ff4c1cc to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309195c5f6b8e73844d85989f3d332ff4c1cc 2023-09-19 00:02:56,776 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309198fcc7408cd004a7dad03e58186753bb2 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309198fcc7408cd004a7dad03e58186753bb2 2023-09-19 00:02:56,776 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-19 00:02:56,778 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,780 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-19 00:02:56,783 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-19 00:02:56,784 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,784 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-19 00:02:56,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081776784"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:56,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081776784"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:56,786 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 00:02:56,786 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f4802616414083297767c7aed6ceea81, NAME => 'testtb-testEmptyExportFileSystemState,,1695081765634.f4802616414083297767c7aed6ceea81.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d06eb823a7f0da185f9a523bbd24a592, NAME => 'testtb-testEmptyExportFileSystemState,1,1695081765634.d06eb823a7f0da185f9a523bbd24a592.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 00:02:56,786 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-19 00:02:56,786 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695081776786"}]},"ts":"9223372036854775807"} 2023-09-19 00:02:56,788 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-19 00:02:56,793 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 00:02:56,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 45 msec 2023-09-19 00:02:56,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-19 00:02:56,862 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-19 00:02:56,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-19 00:02:56,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:56,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-19 00:02:56,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-19 00:02:56,898 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 758) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:37806 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1211708247_1 at /127.0.0.1:32888 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41169 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4617 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:59506 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c025f5e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:36115 from appattempt_1695081683487_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120820395_17 at /127.0.0.1:49162 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1211708247_1 at /127.0.0.1:40010 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:43505 from appattempt_1695081683487_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 174) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8717 (was 8746) 2023-09-19 00:02:56,899 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-19 00:02:56,918 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=170, AvailableMemoryMB=8717 2023-09-19 00:02:56,918 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-19 00:02:56,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 00:02:56,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:56,922 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 00:02:56,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-19 00:02:56,922 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 00:02:56,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 00:02:56,924 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:56,924 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:56,925 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e empty. 2023-09-19 00:02:56,925 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4 empty. 2023-09-19 00:02:56,925 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:56,925 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:56,925 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-19 00:02:56,941 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-19 00:02:56,942 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d11cfa8ecb5e4c600b92b7ae12a2b32e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:56,942 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 549b2d6107dd3ab045fa29aff7f9ace4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp 2023-09-19 00:02:56,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:56,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d11cfa8ecb5e4c600b92b7ae12a2b32e, disabling compactions & flushes 2023-09-19 00:02:56,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:56,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:56,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. after waiting 0 ms 2023-09-19 00:02:56,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:56,958 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:56,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d11cfa8ecb5e4c600b92b7ae12a2b32e: 2023-09-19 00:02:56,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:56,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 549b2d6107dd3ab045fa29aff7f9ace4, disabling compactions & flushes 2023-09-19 00:02:56,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:56,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:56,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. after waiting 0 ms 2023-09-19 00:02:56,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:56,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:56,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 549b2d6107dd3ab045fa29aff7f9ace4: 2023-09-19 00:02:56,963 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 00:02:56,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081776964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081776964"}]},"ts":"1695081776964"} 2023-09-19 00:02:56,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081776964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081776964"}]},"ts":"1695081776964"} 2023-09-19 00:02:56,966 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 00:02:56,966 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 00:02:56,967 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081776966"}]},"ts":"1695081776966"} 2023-09-19 00:02:56,968 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-19 00:02:56,971 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 00:02:56,972 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 00:02:56,972 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 00:02:56,972 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 00:02:56,972 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 00:02:56,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d11cfa8ecb5e4c600b92b7ae12a2b32e, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=549b2d6107dd3ab045fa29aff7f9ace4, ASSIGN}] 2023-09-19 00:02:56,975 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=549b2d6107dd3ab045fa29aff7f9ace4, ASSIGN 2023-09-19 00:02:56,975 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d11cfa8ecb5e4c600b92b7ae12a2b32e, ASSIGN 2023-09-19 00:02:56,976 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=549b2d6107dd3ab045fa29aff7f9ace4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39367,1695081676816; forceNewPlan=false, retain=false 2023-09-19 00:02:56,976 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d11cfa8ecb5e4c600b92b7ae12a2b32e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35543,1695081676765; forceNewPlan=false, retain=false 2023-09-19 00:02:57,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 00:02:57,126 INFO [jenkins-hbase4:45153] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 00:02:57,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=549b2d6107dd3ab045fa29aff7f9ace4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,129 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d11cfa8ecb5e4c600b92b7ae12a2b32e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,129 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081777129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081777129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081777129"}]},"ts":"1695081777129"} 2023-09-19 00:02:57,129 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081777129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081777129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081777129"}]},"ts":"1695081777129"} 2023-09-19 00:02:57,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 549b2d6107dd3ab045fa29aff7f9ace4, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:02:57,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure d11cfa8ecb5e4c600b92b7ae12a2b32e, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:02:57,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 00:02:57,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:57,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 549b2d6107dd3ab045fa29aff7f9ace4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 00:02:57,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. service=AccessControlService 2023-09-19 00:02:57,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:57,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d11cfa8ecb5e4c600b92b7ae12a2b32e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 00:02:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. service=AccessControlService 2023-09-19 00:02:57,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 00:02:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:57,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 00:02:57,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:57,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:57,287 INFO [StoreOpener-549b2d6107dd3ab045fa29aff7f9ace4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:57,288 INFO [StoreOpener-d11cfa8ecb5e4c600b92b7ae12a2b32e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:57,288 DEBUG [StoreOpener-549b2d6107dd3ab045fa29aff7f9ace4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf 2023-09-19 00:02:57,288 DEBUG [StoreOpener-549b2d6107dd3ab045fa29aff7f9ace4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf 2023-09-19 00:02:57,289 INFO [StoreOpener-549b2d6107dd3ab045fa29aff7f9ace4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 549b2d6107dd3ab045fa29aff7f9ace4 columnFamilyName cf 2023-09-19 00:02:57,289 DEBUG [StoreOpener-d11cfa8ecb5e4c600b92b7ae12a2b32e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf 2023-09-19 00:02:57,289 DEBUG [StoreOpener-d11cfa8ecb5e4c600b92b7ae12a2b32e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf 2023-09-19 00:02:57,289 INFO [StoreOpener-d11cfa8ecb5e4c600b92b7ae12a2b32e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d11cfa8ecb5e4c600b92b7ae12a2b32e columnFamilyName cf 2023-09-19 00:02:57,290 INFO [StoreOpener-549b2d6107dd3ab045fa29aff7f9ace4-1] regionserver.HStore(310): Store=549b2d6107dd3ab045fa29aff7f9ace4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:57,290 INFO [StoreOpener-d11cfa8ecb5e4c600b92b7ae12a2b32e-1] regionserver.HStore(310): Store=d11cfa8ecb5e4c600b92b7ae12a2b32e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 00:02:57,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:57,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:57,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:57,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:57,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:02:57,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:02:57,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:57,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 00:02:57,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 549b2d6107dd3ab045fa29aff7f9ace4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68656827, jitterRate=0.023066446185112}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:57,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 549b2d6107dd3ab045fa29aff7f9ace4: 2023-09-19 00:02:57,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d11cfa8ecb5e4c600b92b7ae12a2b32e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59472513, jitterRate=-0.11379049718379974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 00:02:57,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d11cfa8ecb5e4c600b92b7ae12a2b32e: 2023-09-19 00:02:57,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e., pid=109, masterSystemTime=1695081777283 2023-09-19 00:02:57,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4., pid=108, masterSystemTime=1695081777282 2023-09-19 00:02:57,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:57,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:57,299 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=549b2d6107dd3ab045fa29aff7f9ace4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,299 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081777299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081777299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081777299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081777299"}]},"ts":"1695081777299"} 2023-09-19 00:02:57,300 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d11cfa8ecb5e4c600b92b7ae12a2b32e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,300 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081777300"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695081777300"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695081777300"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695081777300"}]},"ts":"1695081777300"} 2023-09-19 00:02:57,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-19 00:02:57,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 549b2d6107dd3ab045fa29aff7f9ace4, server=jenkins-hbase4.apache.org,39367,1695081676816 in 170 msec 2023-09-19 00:02:57,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-19 00:02:57,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure d11cfa8ecb5e4c600b92b7ae12a2b32e, server=jenkins-hbase4.apache.org,35543,1695081676765 in 170 msec 2023-09-19 00:02:57,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=549b2d6107dd3ab045fa29aff7f9ace4, ASSIGN in 329 msec 2023-09-19 00:02:57,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-19 00:02:57,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d11cfa8ecb5e4c600b92b7ae12a2b32e, ASSIGN in 330 msec 2023-09-19 00:02:57,305 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 00:02:57,305 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081777305"}]},"ts":"1695081777305"} 2023-09-19 00:02:57,306 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-19 00:02:57,308 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 00:02:57,308 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-19 00:02:57,309 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 00:02:57,312 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:57,312 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:57,312 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:57,312 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:02:57,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:57,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:57,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:57,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 00:02:57,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 394 msec 2023-09-19 00:02:57,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 00:02:57,526 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-19 00:02:57,528 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,528 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,531 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:57,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 00:02:57,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081777542 (current time:1695081777542). 2023-09-19 00:02:57,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:57,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x1d483310 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:57,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40a19875, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:57,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:57,550 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:57,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d483310 to 127.0.0.1:62806 2023-09-19 00:02:57,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:57,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x5cea36c2 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:57,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@665efc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:57,559 DEBUG [hconnection-0x4c480cb5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:57,562 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:57,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cea36c2 to 127.0.0.1:62806 2023-09-19 00:02:57,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:57,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 00:02:57,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:57,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 00:02:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 00:02:57,570 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 00:02:57,571 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695082377571 2023-09-19 00:02:57,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 00:02:57,572 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:57,572 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:57,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 00:02:57,573 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 00:02:57,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-19 00:02:57,574 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 00:02:57,575 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695082377575 2023-09-19 00:02:57,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,585 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-19 00:02:57,585 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,586 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-19 00:02:57,586 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-19 00:02:57,587 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,587 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,588 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,588 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,588 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,588 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,589 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,589 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,589 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,589 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 00:02:57,590 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,590 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,590 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 00:02:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 00:02:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 00:02:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 00:02:57,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 00:02:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 00:02:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 00:02:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 00:02:57,593 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 00:02:57,593 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 00:02:57,593 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 00:02:57,599 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,600 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,600 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,601 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 00:02:57,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36abed6d[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 00:02:57,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36abed6d[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:57,604 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-19 00:02:57,604 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 00:02:57,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 00:02:57,606 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 00:02:57,606 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. started... 2023-09-19 00:02:57,606 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:57,606 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,607 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 549b2d6107dd3ab045fa29aff7f9ace4: 2023-09-19 00:02:57,607 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. started... 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 00:02:57,607 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,607 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,608 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:57,608 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d11cfa8ecb5e4c600b92b7ae12a2b32e: 2023-09-19 00:02:57,608 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:57,607 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:57,606 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:57,608 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,608 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:57,608 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:57,608 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 00:02:57,610 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 00:02:57,610 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,610 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 00:02:57,620 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. completed. 2023-09-19 00:02:57,620 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:57,620 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. completed. 2023-09-19 00:02:57,620 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 00:02:57,620 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:57,622 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 00:02:57,622 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,622 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 00:02:57,622 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 00:02:57,623 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,623 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,623 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,624 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 00:02:57,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35543,1695081676765': 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:02:57,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-19 00:02:57,630 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-19 00:02:57,630 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:57,630 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:57,631 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,631 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:57,632 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,632 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,632 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,632 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,633 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,634 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,634 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,636 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,636 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,636 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,640 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,639 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,639 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:57,640 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,641 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,642 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,642 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,642 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 00:02:57,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-19 00:02:57,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695081777571Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695081777651 (+80 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695081777651Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695081777651Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695081777655 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695081777666 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695081777671 (+5 ms) 2023-09-19 00:02:57,673 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:57,674 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 00:02:57,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 00:02:57,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:57,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 104 msec 2023-09-19 00:02:57,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:57,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39367] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 00:02:57,681 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,681 DEBUG [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,681 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 00:02:57,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 00:02:57,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695081777689 (current time:1695081777689). 2023-09-19 00:02:57,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 00:02:57,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x25dab0d0 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:57,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29fb2d7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:57,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:57,700 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:57,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25dab0d0 to 127.0.0.1:62806 2023-09-19 00:02:57,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:57,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(139): Connect 0x2f614b00 to 127.0.0.1:62806 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 00:02:57,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f4d220c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 00:02:57,707 DEBUG [hconnection-0x2fad4462-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 00:02:57,708 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 00:02:57,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f614b00 to 127.0.0.1:62806 2023-09-19 00:02:57,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:02:57,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 00:02:57,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 00:02:57,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 00:02:57,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 00:02:57,716 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 00:02:57,717 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695082377717 2023-09-19 00:02:57,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 00:02:57,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,718 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 00:02:57,718 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 00:02:57,719 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 00:02:57,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 00:02:57,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-19 00:02:57,720 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 00:02:57,721 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695082377721 2023-09-19 00:02:57,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,731 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-19 00:02:57,731 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,732 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-19 00:02:57,732 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-19 00:02:57,732 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,732 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,734 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,734 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,735 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,734 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,735 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,735 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,735 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,735 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 00:02:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,736 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 00:02:57,736 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,736 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 00:02:57,737 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 00:02:57,738 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 00:02:57,738 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34277,1695081676849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 00:02:57,737 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 00:02:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 00:02:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 00:02:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 00:02:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 00:02:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 00:02:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 00:02:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 00:02:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,742 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,742 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 00:02:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39367,1695081676816' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e8d50b0[Count = 1] remaining members to acquire global barrier 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35543,1695081676765' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 00:02:57,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e8d50b0[Count = 0] remaining members to acquire global barrier 2023-09-19 00:02:57,746 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-19 00:02:57,746 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 00:02:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,751 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 00:02:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,751 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 00:02:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 00:02:57,752 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 00:02:57,752 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. started... 2023-09-19 00:02:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34277,1695081676849' in zk 2023-09-19 00:02:57,752 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:57,752 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. started... 2023-09-19 00:02:57,752 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 549b2d6107dd3ab045fa29aff7f9ace4 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-19 00:02:57,752 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,752 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 00:02:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 00:02:57,752 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d11cfa8ecb5e4c600b92b7ae12a2b32e 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-19 00:02:57,754 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 00:02:57,754 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,754 DEBUG [member: 'jenkins-hbase4.apache.org,34277,1695081676849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 00:02:57,773 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091901e812627c254e738f6189f1b4016e05 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091901e812627c254e738f6189f1b4016e05 2023-09-19 00:02:57,776 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919c2c6ed87d12e4581aeef94d6a5fe09bb to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919c2c6ed87d12e4581aeef94d6a5fe09bb 2023-09-19 00:02:57,791 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/.tmp/cf/30ee4a2d43c94a908e94dcbc5c8a80a6 2023-09-19 00:02:57,792 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/.tmp/cf/e94591bf41e249a5b05acc196f0c39e7 2023-09-19 00:02:57,797 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/.tmp/cf/30ee4a2d43c94a908e94dcbc5c8a80a6 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf/30ee4a2d43c94a908e94dcbc5c8a80a6 2023-09-19 00:02:57,797 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/.tmp/cf/e94591bf41e249a5b05acc196f0c39e7 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf/e94591bf41e249a5b05acc196f0c39e7 2023-09-19 00:02:57,801 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf/e94591bf41e249a5b05acc196f0c39e7, entries=44, sequenceid=6, filesize=12.8 K 2023-09-19 00:02:57,801 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf/30ee4a2d43c94a908e94dcbc5c8a80a6, entries=6, sequenceid=6, filesize=6.0 K 2023-09-19 00:02:57,802 INFO [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for d11cfa8ecb5e4c600b92b7ae12a2b32e in 50ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:57,802 INFO [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 549b2d6107dd3ab045fa29aff7f9ace4 in 50ms, sequenceid=6, compaction requested=false 2023-09-19 00:02:57,802 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-19 00:02:57,802 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d11cfa8ecb5e4c600b92b7ae12a2b32e: 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 549b2d6107dd3ab045fa29aff7f9ace4: 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf/30ee4a2d43c94a908e94dcbc5c8a80a6] hfiles 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf/e94591bf41e249a5b05acc196f0c39e7] hfiles 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf/e94591bf41e249a5b05acc196f0c39e7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,805 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf/30ee4a2d43c94a908e94dcbc5c8a80a6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,812 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. completed. 2023-09-19 00:02:57,812 DEBUG [rs(jenkins-hbase4.apache.org,35543,1695081676765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:02:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 00:02:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35543,1695081676765' in zk 2023-09-19 00:02:57,813 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. completed. 2023-09-19 00:02:57,813 DEBUG [rs(jenkins-hbase4.apache.org,39367,1695081676816)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:02:57,813 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 00:02:57,813 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 00:02:57,813 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,813 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 00:02:57,813 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39367,1695081676816' in zk 2023-09-19 00:02:57,814 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,814 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 00:02:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,814 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,814 DEBUG [member: 'jenkins-hbase4.apache.org,35543,1695081676765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 00:02:57,816 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,816 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 00:02:57,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,816 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,816 DEBUG [member: 'jenkins-hbase4.apache.org,39367,1695081676816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 00:02:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,818 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 00:02:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-19 00:02:57,819 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 00:02:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35543,1695081676765': 2023-09-19 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35543,1695081676765' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-19 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39367,1695081676816': 2023-09-19 00:02:57,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39367,1695081676816' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-19 00:02:57,824 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-19 00:02:57,824 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 00:02:57,824 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 00:02:57,824 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,824 INFO [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 00:02:57,826 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,826 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,826 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,826 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,826 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,826 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,827 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,827 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,827 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,828 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,829 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 00:02:57,829 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,830 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,832 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,832 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,832 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 00:02:57,832 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,832 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,832 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,833 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,832 DEBUG [(jenkins-hbase4.apache.org,45153,1695081675422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 00:02:57,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 00:02:57,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,832 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 00:02:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 00:02:57,833 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,834 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 00:02:57,834 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,834 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:02:57,834 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 00:02:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,834 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:02:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 00:02:57,835 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:02:57,835 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,835 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919c2c6ed87d12e4581aeef94d6a5fe09bb, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091901e812627c254e738f6189f1b4016e05] mob files 2023-09-19 00:02:57,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919c2c6ed87d12e4581aeef94d6a5fe09bb 2023-09-19 00:02:57,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091901e812627c254e738f6189f1b4016e05 2023-09-19 00:02:57,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-19 00:02:57,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,859 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:57,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695081777717Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695081777841 (+124 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695081777841Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695081777841Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695081777844 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695081777850 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695081777858 (+8 ms) 2023-09-19 00:02:57,861 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 00:02:57,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 143 msec 2023-09-19 00:02:58,019 DEBUG [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 00:02:58,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 00:02:58,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 00:02:58,021 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021 2023-09-19 00:02:58,021 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:58,052 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a 2023-09-19 00:02:58,052 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1497398317_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:58,052 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-19 00:02:58,061 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:02:58,077 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:58,077 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:58,078 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:58,078 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:58,953 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-4192076054639837838.jar 2023-09-19 00:02:58,953 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:58,953 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:59,020 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/hadoop-1640337623385768072.jar 2023-09-19 00:02:59,020 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:59,021 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:59,021 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:59,021 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:59,022 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:59,022 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 00:02:59,022 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 00:02:59,023 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 00:02:59,023 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 00:02:59,024 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 00:02:59,024 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 00:02:59,024 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 00:02:59,025 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 00:02:59,025 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 00:02:59,025 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 00:02:59,026 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 00:02:59,026 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:59,027 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:59,027 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:59,027 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:59,027 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 00:02:59,028 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:59,028 DEBUG [Listener at jenkins-hbase4.apache.org/39435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 00:02:59,375 WARN [Listener at jenkins-hbase4.apache.org/39435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 00:02:59,377 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-19 00:02:59,378 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-19 00:03:00,634 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:03:00,634 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 00:03:00,636 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0006_000001 (auth:SIMPLE) 2023-09-19 00:03:01,445 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0007_000001 (auth:SIMPLE) 2023-09-19 00:03:02,211 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:03:05,197 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0007_000001 (auth:SIMPLE) 2023-09-19 00:03:07,405 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0007_000001 (auth:SIMPLE) 2023-09-19 00:03:10,016 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695081683487_0007_000001 (auth:SIMPLE) 2023-09-19 00:03:11,544 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 00:03:11,544 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 00:03:11,554 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,554 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 00:03:11,555 INFO [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 00:03:11,555 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,555 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-19 00:03:11,555 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-19 00:03:11,555 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120820395_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,556 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-19 00:03:11,556 DEBUG [Listener at jenkins-hbase4.apache.org/39435] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/export-test/export-1695081778021/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-19 00:03:11,561 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 00:03:11,565 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081791565"}]},"ts":"1695081791565"} 2023-09-19 00:03:11,567 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-19 00:03:11,568 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-19 00:03:11,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d11cfa8ecb5e4c600b92b7ae12a2b32e, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=549b2d6107dd3ab045fa29aff7f9ace4, UNASSIGN}] 2023-09-19 00:03:11,570 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d11cfa8ecb5e4c600b92b7ae12a2b32e, UNASSIGN 2023-09-19 00:03:11,570 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=549b2d6107dd3ab045fa29aff7f9ace4, UNASSIGN 2023-09-19 00:03:11,571 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d11cfa8ecb5e4c600b92b7ae12a2b32e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:03:11,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=549b2d6107dd3ab045fa29aff7f9ace4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:03:11,571 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081791571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081791571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081791571"}]},"ts":"1695081791571"} 2023-09-19 00:03:11,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081791571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695081791571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695081791571"}]},"ts":"1695081791571"} 2023-09-19 00:03:11,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d11cfa8ecb5e4c600b92b7ae12a2b32e, server=jenkins-hbase4.apache.org,35543,1695081676765}] 2023-09-19 00:03:11,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 549b2d6107dd3ab045fa29aff7f9ace4, server=jenkins-hbase4.apache.org,39367,1695081676816}] 2023-09-19 00:03:11,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 00:03:11,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:03:11,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:03:11,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 549b2d6107dd3ab045fa29aff7f9ace4, disabling compactions & flushes 2023-09-19 00:03:11,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d11cfa8ecb5e4c600b92b7ae12a2b32e, disabling compactions & flushes 2023-09-19 00:03:11,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:03:11,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:03:11,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:03:11,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:03:11,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. after waiting 0 ms 2023-09-19 00:03:11,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:03:11,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. after waiting 0 ms 2023-09-19 00:03:11,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:03:11,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:03:11,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:03:11,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:11,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:11,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e. 2023-09-19 00:03:11,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d11cfa8ecb5e4c600b92b7ae12a2b32e: 2023-09-19 00:03:11,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4. 2023-09-19 00:03:11,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 549b2d6107dd3ab045fa29aff7f9ace4: 2023-09-19 00:03:11,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:03:11,741 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d11cfa8ecb5e4c600b92b7ae12a2b32e, regionState=CLOSED 2023-09-19 00:03:11,742 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081791741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081791741"}]},"ts":"1695081791741"} 2023-09-19 00:03:11,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:03:11,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=549b2d6107dd3ab045fa29aff7f9ace4, regionState=CLOSED 2023-09-19 00:03:11,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695081791742"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695081791742"}]},"ts":"1695081791742"} 2023-09-19 00:03:11,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-19 00:03:11,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d11cfa8ecb5e4c600b92b7ae12a2b32e, server=jenkins-hbase4.apache.org,35543,1695081676765 in 171 msec 2023-09-19 00:03:11,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-19 00:03:11,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 549b2d6107dd3ab045fa29aff7f9ace4, server=jenkins-hbase4.apache.org,39367,1695081676816 in 170 msec 2023-09-19 00:03:11,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d11cfa8ecb5e4c600b92b7ae12a2b32e, UNASSIGN in 178 msec 2023-09-19 00:03:11,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-19 00:03:11,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=549b2d6107dd3ab045fa29aff7f9ace4, UNASSIGN in 180 msec 2023-09-19 00:03:11,751 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695081791751"}]},"ts":"1695081791751"} 2023-09-19 00:03:11,752 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-19 00:03:11,755 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-19 00:03:11,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-09-19 00:03:11,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 00:03:11,868 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-19 00:03:11,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,871 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,872 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,873 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39367] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,876 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,876 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,876 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,876 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,876 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:03:11,876 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:03:11,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 00:03:11,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 00:03:11,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 00:03:11,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:03:11,878 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 00:03:11,879 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/recovered.edits] 2023-09-19 00:03:11,879 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/recovered.edits] 2023-09-19 00:03:11,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-19 00:03:11,882 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf/30ee4a2d43c94a908e94dcbc5c8a80a6 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/cf/30ee4a2d43c94a908e94dcbc5c8a80a6 2023-09-19 00:03:11,882 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf/e94591bf41e249a5b05acc196f0c39e7 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/cf/e94591bf41e249a5b05acc196f0c39e7 2023-09-19 00:03:11,885 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e/recovered.edits/9.seqid 2023-09-19 00:03:11,885 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4/recovered.edits/9.seqid 2023-09-19 00:03:11,886 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d11cfa8ecb5e4c600b92b7ae12a2b32e 2023-09-19 00:03:11,886 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/549b2d6107dd3ab045fa29aff7f9ace4 2023-09-19 00:03:11,886 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-19 00:03:11,886 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-19 00:03:11,887 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-19 00:03:11,890 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919c2c6ed87d12e4581aeef94d6a5fe09bb to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919c2c6ed87d12e4581aeef94d6a5fe09bb 2023-09-19 00:03:11,891 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091901e812627c254e738f6189f1b4016e05 to hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091901e812627c254e738f6189f1b4016e05 2023-09-19 00:03:11,892 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-19 00:03:11,894 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,896 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-19 00:03:11,897 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-19 00:03:11,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-19 00:03:11,898 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081791898"}]},"ts":"9223372036854775807"} 2023-09-19 00:03:11,899 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695081791898"}]},"ts":"9223372036854775807"} 2023-09-19 00:03:11,900 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 00:03:11,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d11cfa8ecb5e4c600b92b7ae12a2b32e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695081776919.d11cfa8ecb5e4c600b92b7ae12a2b32e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 549b2d6107dd3ab045fa29aff7f9ace4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695081776919.549b2d6107dd3ab045fa29aff7f9ace4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 00:03:11,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-19 00:03:11,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695081791900"}]},"ts":"9223372036854775807"} 2023-09-19 00:03:11,902 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-19 00:03:11,904 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-19 00:03:11,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-19 00:03:11,980 INFO [Listener at jenkins-hbase4.apache.org/39435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-19 00:03:11,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-19 00:03:11,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:11,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-19 00:03:11,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45153] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 00:03:12,015 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 766), OpenFileDescriptor=905 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 194) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 170), AvailableMemoryMB=8642 (was 8717) 2023-09-19 00:03:12,015 WARN [Listener at jenkins-hbase4.apache.org/39435] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-19 00:03:12,015 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-19 00:03:12,025 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 00:03:12,136 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695081683487_0007_01_000001 is : 143 2023-09-19 00:03:17,303 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 00:03:26,151 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 00:03:40,269 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 00:03:40,270 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 00:03:40,378 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-19 00:03:40,388 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-19 00:03:40,389 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 00:03:40,397 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 00:03:40,500 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 00:03:40,501 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-19 00:03:40,501 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-19 00:03:40,501 INFO [Listener at jenkins-hbase4.apache.org/39435] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-19 00:03:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/39435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x782e04b0 to 127.0.0.1:62806 2023-09-19 00:03:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/39435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/39435] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-19 00:03:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/39435] util.JVMClusterUtil(257): Found active master hash=775040334, stopped=false 2023-09-19 00:03:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/39435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/39435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-19 00:03:40,502 INFO [Listener at jenkins-hbase4.apache.org/39435] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:03:40,503 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 00:03:40,503 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 00:03:40,503 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 00:03:40,503 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 00:03:40,503 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:03:40,503 INFO [Listener at jenkins-hbase4.apache.org/39435] procedure2.ProcedureExecutor(628): Stopping 2023-09-19 00:03:40,503 DEBUG [Listener at jenkins-hbase4.apache.org/39435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a2539bf to 127.0.0.1:62806 2023-09-19 00:03:40,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:03:40,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:03:40,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:03:40,503 DEBUG [Listener at jenkins-hbase4.apache.org/39435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:40,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 00:03:40,504 INFO [Listener at jenkins-hbase4.apache.org/39435] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35543,1695081676765' ***** 2023-09-19 00:03:40,504 DEBUG [Listener at jenkins-hbase4.apache.org/39435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:40,504 INFO [Listener at jenkins-hbase4.apache.org/39435] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 00:03:40,504 INFO [Listener at jenkins-hbase4.apache.org/39435] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39367,1695081676816' ***** 2023-09-19 00:03:40,504 DEBUG [Listener at jenkins-hbase4.apache.org/39435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:40,504 INFO [Listener at jenkins-hbase4.apache.org/39435] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 00:03:40,504 INFO [RS:0;jenkins-hbase4:35543] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 00:03:40,504 INFO [Listener at jenkins-hbase4.apache.org/39435] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34277,1695081676849' ***** 2023-09-19 00:03:40,505 INFO [RS:1;jenkins-hbase4:39367] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 00:03:40,505 INFO [RS:0;jenkins-hbase4:35543] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 00:03:40,505 INFO [RS:1;jenkins-hbase4:39367] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 00:03:40,505 INFO [RS:0;jenkins-hbase4:35543] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 00:03:40,505 DEBUG [Listener at jenkins-hbase4.apache.org/39435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:40,505 INFO [RS:1;jenkins-hbase4:39367] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 00:03:40,505 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 00:03:40,505 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(3305): Received CLOSE for c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:03:40,505 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 00:03:40,505 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(3305): Received CLOSE for 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:03:40,505 INFO [Listener at jenkins-hbase4.apache.org/39435] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 00:03:40,505 INFO [RS:2;jenkins-hbase4:34277] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 00:03:40,505 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:03:40,505 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 00:03:40,506 DEBUG [RS:1;jenkins-hbase4:39367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72c805b5 to 127.0.0.1:62806 2023-09-19 00:03:40,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 779c17ce2e69dff7c9a8d5348ef6f6d4, disabling compactions & flushes 2023-09-19 00:03:40,505 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:03:40,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:03:40,507 DEBUG [RS:0;jenkins-hbase4:35543] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c233932 to 127.0.0.1:62806 2023-09-19 00:03:40,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:03:40,507 DEBUG [RS:0;jenkins-hbase4:35543] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:40,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. after waiting 0 ms 2023-09-19 00:03:40,506 DEBUG [RS:1;jenkins-hbase4:39367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:40,508 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-19 00:03:40,510 INFO [RS:1;jenkins-hbase4:39367] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 00:03:40,510 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1478): Online Regions={c7a1e9d93d6eb9dc2d446972efd4d1bd=hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd.} 2023-09-19 00:03:40,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7a1e9d93d6eb9dc2d446972efd4d1bd, disabling compactions & flushes 2023-09-19 00:03:40,505 INFO [RS:2;jenkins-hbase4:34277] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 00:03:40,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:03:40,510 INFO [RS:2;jenkins-hbase4:34277] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 00:03:40,510 INFO [RS:1;jenkins-hbase4:39367] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 00:03:40,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:03:40,510 INFO [RS:1;jenkins-hbase4:39367] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 00:03:40,510 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:03:40,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:03:40,510 DEBUG [RS:2;jenkins-hbase4:34277] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58778c48 to 127.0.0.1:62806 2023-09-19 00:03:40,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. after waiting 0 ms 2023-09-19 00:03:40,510 DEBUG [RS:2;jenkins-hbase4:34277] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:40,510 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-19 00:03:40,511 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34277,1695081676849; all regions closed. 2023-09-19 00:03:40,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 779c17ce2e69dff7c9a8d5348ef6f6d4 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-19 00:03:40,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:03:40,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c7a1e9d93d6eb9dc2d446972efd4d1bd 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-19 00:03:40,511 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-19 00:03:40,511 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1478): Online Regions={779c17ce2e69dff7c9a8d5348ef6f6d4=hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4., 1588230740=hbase:meta,,1.1588230740} 2023-09-19 00:03:40,512 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-19 00:03:40,512 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1504): Waiting on c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:03:40,512 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1504): Waiting on 1588230740, 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:03:40,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-19 00:03:40,512 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-19 00:03:40,512 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-19 00:03:40,512 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-19 00:03:40,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-19 00:03:40,533 DEBUG [RS:2;jenkins-hbase4:34277] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs 2023-09-19 00:03:40,534 INFO [RS:2;jenkins-hbase4:34277] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34277%2C1695081676849:(num 1695081678531) 2023-09-19 00:03:40,534 DEBUG [RS:2;jenkins-hbase4:34277] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:40,534 INFO [RS:2;jenkins-hbase4:34277] regionserver.LeaseManager(133): Closed leases 2023-09-19 00:03:40,535 INFO [RS:2;jenkins-hbase4:34277] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-19 00:03:40,535 INFO [RS:2;jenkins-hbase4:34277] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 00:03:40,535 INFO [RS:2;jenkins-hbase4:34277] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 00:03:40,535 INFO [RS:2;jenkins-hbase4:34277] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 00:03:40,536 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 00:03:40,537 INFO [RS:2;jenkins-hbase4:34277] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34277 2023-09-19 00:03:40,542 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/.tmp/info/81a5ed9590de4a67bf18da277b02825b 2023-09-19 00:03:40,543 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 00:03:40,543 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:03:40,543 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 00:03:40,543 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:03:40,543 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34277,1695081676849 2023-09-19 00:03:40,543 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 00:03:40,543 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 00:03:40,543 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34277,1695081676849] 2023-09-19 00:03:40,544 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34277,1695081676849; numProcessing=1 2023-09-19 00:03:40,546 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34277,1695081676849 already deleted, retry=false 2023-09-19 00:03:40,546 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34277,1695081676849 expired; onlineServers=2 2023-09-19 00:03:40,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81a5ed9590de4a67bf18da277b02825b 2023-09-19 00:03:40,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/.tmp/rep_barrier/2c9c7d4daf5d450ea9a03caaf2eecabb 2023-09-19 00:03:40,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c9c7d4daf5d450ea9a03caaf2eecabb 2023-09-19 00:03:40,568 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/.tmp/table/4bab61d4365d4145a3572880ed690c54 2023-09-19 00:03:40,572 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bab61d4365d4145a3572880ed690c54 2023-09-19 00:03:40,572 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/.tmp/info/81a5ed9590de4a67bf18da277b02825b as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/info/81a5ed9590de4a67bf18da277b02825b 2023-09-19 00:03:40,573 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 00:03:40,573 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 00:03:40,573 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 00:03:40,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81a5ed9590de4a67bf18da277b02825b 2023-09-19 00:03:40,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/info/81a5ed9590de4a67bf18da277b02825b, entries=48, sequenceid=131, filesize=10.3 K 2023-09-19 00:03:40,577 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/.tmp/rep_barrier/2c9c7d4daf5d450ea9a03caaf2eecabb as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/rep_barrier/2c9c7d4daf5d450ea9a03caaf2eecabb 2023-09-19 00:03:40,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c9c7d4daf5d450ea9a03caaf2eecabb 2023-09-19 00:03:40,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/rep_barrier/2c9c7d4daf5d450ea9a03caaf2eecabb, entries=13, sequenceid=131, filesize=6.4 K 2023-09-19 00:03:40,582 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/.tmp/table/4bab61d4365d4145a3572880ed690c54 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/table/4bab61d4365d4145a3572880ed690c54 2023-09-19 00:03:40,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bab61d4365d4145a3572880ed690c54 2023-09-19 00:03:40,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/table/4bab61d4365d4145a3572880ed690c54, entries=24, sequenceid=131, filesize=6.9 K 2023-09-19 00:03:40,586 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 74ms, sequenceid=131, compaction requested=false 2023-09-19 00:03:40,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-19 00:03:40,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:40,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-19 00:03:40,596 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-19 00:03:40,596 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-19 00:03:40,596 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-19 00:03:40,645 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:40,645 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:34277-0x100c17cee750003, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:40,645 INFO [RS:2;jenkins-hbase4:34277] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34277,1695081676849; zookeeper connection closed. 2023-09-19 00:03:40,645 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1cef5b2d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1cef5b2d 2023-09-19 00:03:40,712 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1504): Waiting on c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:03:40,712 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1504): Waiting on 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:03:40,912 DEBUG [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1504): Waiting on c7a1e9d93d6eb9dc2d446972efd4d1bd 2023-09-19 00:03:40,912 DEBUG [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1504): Waiting on 779c17ce2e69dff7c9a8d5348ef6f6d4 2023-09-19 00:03:40,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/.tmp/info/d9c4e65d9a4c4be7aa5f85a9b2a6a104 2023-09-19 00:03:40,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/.tmp/l/ac11bb16431b4804adc604759ab069be 2023-09-19 00:03:40,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac11bb16431b4804adc604759ab069be 2023-09-19 00:03:40,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/.tmp/info/d9c4e65d9a4c4be7aa5f85a9b2a6a104 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/info/d9c4e65d9a4c4be7aa5f85a9b2a6a104 2023-09-19 00:03:40,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/.tmp/l/ac11bb16431b4804adc604759ab069be as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/l/ac11bb16431b4804adc604759ab069be 2023-09-19 00:03:40,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac11bb16431b4804adc604759ab069be 2023-09-19 00:03:40,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/info/d9c4e65d9a4c4be7aa5f85a9b2a6a104, entries=2, sequenceid=6, filesize=4.8 K 2023-09-19 00:03:40,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/l/ac11bb16431b4804adc604759ab069be, entries=7, sequenceid=18, filesize=5.2 K 2023-09-19 00:03:40,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c7a1e9d93d6eb9dc2d446972efd4d1bd in 441ms, sequenceid=6, compaction requested=false 2023-09-19 00:03:40,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 779c17ce2e69dff7c9a8d5348ef6f6d4 in 442ms, sequenceid=18, compaction requested=false 2023-09-19 00:03:40,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/namespace/c7a1e9d93d6eb9dc2d446972efd4d1bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 00:03:40,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/data/hbase/acl/779c17ce2e69dff7c9a8d5348ef6f6d4/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-19 00:03:40,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:40,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 00:03:40,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:03:40,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:03:40,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7a1e9d93d6eb9dc2d446972efd4d1bd: 2023-09-19 00:03:40,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 779c17ce2e69dff7c9a8d5348ef6f6d4: 2023-09-19 00:03:40,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695081679056.c7a1e9d93d6eb9dc2d446972efd4d1bd. 2023-09-19 00:03:40,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695081679805.779c17ce2e69dff7c9a8d5348ef6f6d4. 2023-09-19 00:03:41,112 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35543,1695081676765; all regions closed. 2023-09-19 00:03:41,112 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39367,1695081676816; all regions closed. 2023-09-19 00:03:41,121 DEBUG [RS:1;jenkins-hbase4:39367] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs 2023-09-19 00:03:41,121 DEBUG [RS:0;jenkins-hbase4:35543] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs 2023-09-19 00:03:41,121 INFO [RS:1;jenkins-hbase4:39367] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39367%2C1695081676816.meta:.meta(num 1695081678675) 2023-09-19 00:03:41,121 INFO [RS:0;jenkins-hbase4:35543] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35543%2C1695081676765:(num 1695081678531) 2023-09-19 00:03:41,122 DEBUG [RS:0;jenkins-hbase4:35543] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:41,122 INFO [RS:0;jenkins-hbase4:35543] regionserver.LeaseManager(133): Closed leases 2023-09-19 00:03:41,122 INFO [RS:0;jenkins-hbase4:35543] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-19 00:03:41,122 INFO [RS:0;jenkins-hbase4:35543] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 00:03:41,123 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 00:03:41,123 INFO [RS:0;jenkins-hbase4:35543] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 00:03:41,123 INFO [RS:0;jenkins-hbase4:35543] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 00:03:41,124 INFO [RS:0;jenkins-hbase4:35543] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35543 2023-09-19 00:03:41,125 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:03:41,125 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35543,1695081676765 2023-09-19 00:03:41,125 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 00:03:41,127 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35543,1695081676765] 2023-09-19 00:03:41,127 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35543,1695081676765; numProcessing=2 2023-09-19 00:03:41,129 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35543,1695081676765 already deleted, retry=false 2023-09-19 00:03:41,129 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35543,1695081676765 expired; onlineServers=1 2023-09-19 00:03:41,135 DEBUG [RS:1;jenkins-hbase4:39367] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/oldWALs 2023-09-19 00:03:41,135 INFO [RS:1;jenkins-hbase4:39367] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39367%2C1695081676816:(num 1695081678531) 2023-09-19 00:03:41,135 DEBUG [RS:1;jenkins-hbase4:39367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:41,135 INFO [RS:1;jenkins-hbase4:39367] regionserver.LeaseManager(133): Closed leases 2023-09-19 00:03:41,135 INFO [RS:1;jenkins-hbase4:39367] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-19 00:03:41,135 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 00:03:41,136 INFO [RS:1;jenkins-hbase4:39367] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39367 2023-09-19 00:03:41,139 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 00:03:41,139 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39367,1695081676816 2023-09-19 00:03:41,140 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39367,1695081676816] 2023-09-19 00:03:41,140 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39367,1695081676816; numProcessing=3 2023-09-19 00:03:41,141 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39367,1695081676816 already deleted, retry=false 2023-09-19 00:03:41,141 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39367,1695081676816 expired; onlineServers=0 2023-09-19 00:03:41,141 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45153,1695081675422' ***** 2023-09-19 00:03:41,141 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-19 00:03:41,142 DEBUG [M:0;jenkins-hbase4:45153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f0f2775, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 00:03:41,142 INFO [M:0;jenkins-hbase4:45153] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45153,1695081675422 2023-09-19 00:03:41,142 INFO [M:0;jenkins-hbase4:45153] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45153,1695081675422; all regions closed. 2023-09-19 00:03:41,142 DEBUG [M:0;jenkins-hbase4:45153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 00:03:41,142 DEBUG [M:0;jenkins-hbase4:45153] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-19 00:03:41,142 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-19 00:03:41,142 DEBUG [M:0;jenkins-hbase4:45153] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-19 00:03:41,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695081678145] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695081678145,5,FailOnTimeoutGroup] 2023-09-19 00:03:41,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695081678145] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695081678145,5,FailOnTimeoutGroup] 2023-09-19 00:03:41,142 INFO [M:0;jenkins-hbase4:45153] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-19 00:03:41,142 INFO [M:0;jenkins-hbase4:45153] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-19 00:03:41,142 INFO [M:0;jenkins-hbase4:45153] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-19 00:03:41,142 DEBUG [M:0;jenkins-hbase4:45153] master.HMaster(1512): Stopping service threads 2023-09-19 00:03:41,142 INFO [M:0;jenkins-hbase4:45153] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-19 00:03:41,143 ERROR [M:0;jenkins-hbase4:45153] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-09-19 00:03:41,143 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-19 00:03:41,143 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 00:03:41,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 00:03:41,143 INFO [M:0;jenkins-hbase4:45153] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-19 00:03:41,143 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-19 00:03:41,144 DEBUG [M:0;jenkins-hbase4:45153] zookeeper.ZKUtil(398): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-19 00:03:41,144 WARN [M:0;jenkins-hbase4:45153] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-19 00:03:41,144 INFO [M:0;jenkins-hbase4:45153] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-19 00:03:41,144 INFO [M:0;jenkins-hbase4:45153] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-19 00:03:41,145 DEBUG [M:0;jenkins-hbase4:45153] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-19 00:03:41,145 INFO [M:0;jenkins-hbase4:45153] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:03:41,145 DEBUG [M:0;jenkins-hbase4:45153] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:03:41,145 DEBUG [M:0;jenkins-hbase4:45153] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-19 00:03:41,145 DEBUG [M:0;jenkins-hbase4:45153] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:03:41,145 INFO [M:0;jenkins-hbase4:45153] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.93 KB heapSize=452.17 KB 2023-09-19 00:03:41,162 INFO [M:0;jenkins-hbase4:45153] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.93 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0217545f947e4504887cc34219b93c00 2023-09-19 00:03:41,166 INFO [M:0;jenkins-hbase4:45153] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0217545f947e4504887cc34219b93c00 2023-09-19 00:03:41,167 DEBUG [M:0;jenkins-hbase4:45153] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0217545f947e4504887cc34219b93c00 as hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0217545f947e4504887cc34219b93c00 2023-09-19 00:03:41,171 INFO [M:0;jenkins-hbase4:45153] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0217545f947e4504887cc34219b93c00 2023-09-19 00:03:41,171 INFO [M:0;jenkins-hbase4:45153] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/e30682c6-c0e9-1055-599d-b88cc0acc92a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0217545f947e4504887cc34219b93c00, entries=119, sequenceid=899, filesize=28.7 K 2023-09-19 00:03:41,172 INFO [M:0;jenkins-hbase4:45153] regionserver.HRegion(2948): Finished flush of dataSize ~375.93 KB/384949, heapSize ~452.16 KB/463008, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-09-19 00:03:41,174 INFO [M:0;jenkins-hbase4:45153] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 00:03:41,174 DEBUG [M:0;jenkins-hbase4:45153] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 00:03:41,178 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 00:03:41,178 INFO [M:0;jenkins-hbase4:45153] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-19 00:03:41,179 INFO [M:0;jenkins-hbase4:45153] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45153 2023-09-19 00:03:41,181 DEBUG [M:0;jenkins-hbase4:45153] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45153,1695081675422 already deleted, retry=false 2023-09-19 00:03:41,227 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:41,227 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x100c17cee750001, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:41,227 INFO [RS:0;jenkins-hbase4:35543] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35543,1695081676765; zookeeper connection closed. 2023-09-19 00:03:41,228 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f4904c8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f4904c8 2023-09-19 00:03:41,328 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:41,328 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): master:45153-0x100c17cee750000, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:41,328 INFO [M:0;jenkins-hbase4:45153] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45153,1695081675422; zookeeper connection closed. 2023-09-19 00:03:41,428 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:41,428 INFO [RS:1;jenkins-hbase4:39367] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39367,1695081676816; zookeeper connection closed. 2023-09-19 00:03:41,428 DEBUG [Listener at localhost/37725-EventThread] zookeeper.ZKWatcher(600): regionserver:39367-0x100c17cee750002, quorum=127.0.0.1:62806, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 00:03:41,428 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1aee4ca] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1aee4ca 2023-09-19 00:03:41,429 INFO [Listener at jenkins-hbase4.apache.org/39435] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-19 00:03:41,429 WARN [Listener at jenkins-hbase4.apache.org/39435] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 00:03:41,433 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 00:03:41,535 WARN [BP-1292966147-172.31.14.131-1695081671717 heartbeating to localhost/127.0.0.1:36399] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 00:03:41,535 WARN [BP-1292966147-172.31.14.131-1695081671717 heartbeating to localhost/127.0.0.1:36399] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1292966147-172.31.14.131-1695081671717 (Datanode Uuid 1114d34d-79a5-4ccd-be42-f7b88d129a86) service to localhost/127.0.0.1:36399 2023-09-19 00:03:41,537 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data5/current/BP-1292966147-172.31.14.131-1695081671717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 00:03:41,538 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data6/current/BP-1292966147-172.31.14.131-1695081671717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 00:03:41,539 WARN [Listener at jenkins-hbase4.apache.org/39435] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 00:03:41,541 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 00:03:41,644 WARN [BP-1292966147-172.31.14.131-1695081671717 heartbeating to localhost/127.0.0.1:36399] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 00:03:41,644 WARN [BP-1292966147-172.31.14.131-1695081671717 heartbeating to localhost/127.0.0.1:36399] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1292966147-172.31.14.131-1695081671717 (Datanode Uuid e32d1ce4-9fc2-4c73-9e78-a0c2e66c5480) service to localhost/127.0.0.1:36399 2023-09-19 00:03:41,644 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data3/current/BP-1292966147-172.31.14.131-1695081671717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 00:03:41,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data4/current/BP-1292966147-172.31.14.131-1695081671717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 00:03:41,645 WARN [Listener at jenkins-hbase4.apache.org/39435] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 00:03:41,648 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 00:03:41,751 WARN [BP-1292966147-172.31.14.131-1695081671717 heartbeating to localhost/127.0.0.1:36399] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 00:03:41,751 WARN [BP-1292966147-172.31.14.131-1695081671717 heartbeating to localhost/127.0.0.1:36399] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1292966147-172.31.14.131-1695081671717 (Datanode Uuid 09ebf97c-6f57-4c31-b940-e8c7ca284544) service to localhost/127.0.0.1:36399 2023-09-19 00:03:41,752 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data1/current/BP-1292966147-172.31.14.131-1695081671717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 00:03:41,752 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7235a7d4-e4e6-9953-311c-eb02cf188b2e/cluster_74f67c76-0ee5-5f8c-3d18-681613eaed44/dfs/data/data2/current/BP-1292966147-172.31.14.131-1695081671717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 00:03:41,773 INFO [Listener at jenkins-hbase4.apache.org/39435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 00:03:41,899 INFO [Listener at jenkins-hbase4.apache.org/39435] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-19 00:03:41,986 INFO [Listener at jenkins-hbase4.apache.org/39435] hbase.HBaseTestingUtility(1293): Minicluster is down