2023-09-15 05:00:49,085 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-15 05:00:49,307 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff 2023-09-15 05:00:49,308 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-15 05:00:49,308 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-15 05:00:49,344 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-15 05:00:49,599 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-15 05:00:49,599 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab, deleteOnExit=true 2023-09-15 05:00:49,599 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-15 05:00:49,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/test.cache.data in system properties and HBase conf 2023-09-15 05:00:49,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop.tmp.dir in system properties and HBase conf 2023-09-15 05:00:49,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop.log.dir in system properties and HBase conf 2023-09-15 05:00:49,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-15 05:00:49,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-15 05:00:49,601 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-15 05:00:49,915 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-15 05:00:49,919 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-15 05:00:49,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-15 05:00:49,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-15 05:00:49,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 05:00:49,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-15 05:00:49,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-15 05:00:49,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 05:00:49,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 05:00:49,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-15 05:00:49,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/nfs.dump.dir in system properties and HBase conf 2023-09-15 05:00:49,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir in system properties and HBase conf 2023-09-15 05:00:49,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 05:00:49,923 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-15 05:00:49,923 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-15 05:00:50,446 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-15 05:00:50,451 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-15 05:00:50,777 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-15 05:00:50,968 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-15 05:00:50,982 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:00:51,021 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:00:51,055 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_localhost_33489_hdfs____.2xo41t/webapp 2023-09-15 05:00:51,205 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33489 2023-09-15 05:00:51,251 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-15 05:00:51,252 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-15 05:00:51,703 WARN [Listener at localhost/41743] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 05:00:51,775 WARN [Listener at localhost/41743] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 05:00:51,794 WARN [Listener at localhost/41743] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:00:51,801 INFO [Listener at localhost/41743] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:00:51,806 INFO [Listener at localhost/41743] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_localhost_34301_datanode____qxgb8a/webapp 2023-09-15 05:00:51,902 INFO [Listener at localhost/41743] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34301 2023-09-15 05:00:52,385 WARN [Listener at localhost/38663] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 05:00:52,398 WARN [Listener at localhost/38663] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 05:00:52,402 WARN [Listener at localhost/38663] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:00:52,405 INFO [Listener at localhost/38663] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:00:52,415 INFO [Listener at localhost/38663] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_localhost_38177_datanode____.2acsel/webapp 2023-09-15 05:00:52,518 INFO [Listener at localhost/38663] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38177 2023-09-15 05:00:52,532 WARN [Listener at localhost/45239] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 05:00:52,549 WARN [Listener at localhost/45239] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 05:00:52,552 WARN [Listener at localhost/45239] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:00:52,553 INFO [Listener at localhost/45239] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:00:52,559 INFO [Listener at localhost/45239] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_localhost_35529_datanode____ct50n5/webapp 2023-09-15 05:00:52,705 INFO [Listener at localhost/45239] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35529 2023-09-15 05:00:52,729 WARN [Listener at localhost/44249] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 05:00:53,003 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd001ad1d23a1032: Processing first storage report for DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0 from datanode 818af21e-01e8-4318-bb07-1dcb1e5e3240 2023-09-15 05:00:53,005 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd001ad1d23a1032: from storage DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0 node DatanodeRegistration(127.0.0.1:42475, datanodeUuid=818af21e-01e8-4318-bb07-1dcb1e5e3240, infoPort=34989, infoSecurePort=0, ipcPort=44249, storageInfo=lv=-57;cid=testClusterID;nsid=1390561497;c=1694754050539), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-15 05:00:53,005 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cdc50fe9ff8aac4: Processing first storage report for DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819 from datanode 0ae8d1fb-e68f-4079-9e7f-a2928f69005b 2023-09-15 05:00:53,005 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cdc50fe9ff8aac4: from storage DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819 node DatanodeRegistration(127.0.0.1:35417, datanodeUuid=0ae8d1fb-e68f-4079-9e7f-a2928f69005b, infoPort=37041, infoSecurePort=0, ipcPort=38663, storageInfo=lv=-57;cid=testClusterID;nsid=1390561497;c=1694754050539), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x354ebb1872a672bd: Processing first storage report for DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f from datanode cc8b44d1-9bc0-4abf-ad2e-c763ae414b4d 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x354ebb1872a672bd: from storage DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f node DatanodeRegistration(127.0.0.1:38055, datanodeUuid=cc8b44d1-9bc0-4abf-ad2e-c763ae414b4d, infoPort=35991, infoSecurePort=0, ipcPort=45239, storageInfo=lv=-57;cid=testClusterID;nsid=1390561497;c=1694754050539), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd001ad1d23a1032: Processing first storage report for DS-6f00ba11-c92d-4531-9399-9a8bdb325e31 from datanode 818af21e-01e8-4318-bb07-1dcb1e5e3240 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd001ad1d23a1032: from storage DS-6f00ba11-c92d-4531-9399-9a8bdb325e31 node DatanodeRegistration(127.0.0.1:42475, datanodeUuid=818af21e-01e8-4318-bb07-1dcb1e5e3240, infoPort=34989, infoSecurePort=0, ipcPort=44249, storageInfo=lv=-57;cid=testClusterID;nsid=1390561497;c=1694754050539), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cdc50fe9ff8aac4: Processing first storage report for DS-e86ee844-ca9d-47fd-ae77-e56847da7d33 from datanode 0ae8d1fb-e68f-4079-9e7f-a2928f69005b 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cdc50fe9ff8aac4: from storage DS-e86ee844-ca9d-47fd-ae77-e56847da7d33 node DatanodeRegistration(127.0.0.1:35417, datanodeUuid=0ae8d1fb-e68f-4079-9e7f-a2928f69005b, infoPort=37041, infoSecurePort=0, ipcPort=38663, storageInfo=lv=-57;cid=testClusterID;nsid=1390561497;c=1694754050539), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x354ebb1872a672bd: Processing first storage report for DS-ce5059d2-7b2b-49a3-be85-017b2f074355 from datanode cc8b44d1-9bc0-4abf-ad2e-c763ae414b4d 2023-09-15 05:00:53,006 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x354ebb1872a672bd: from storage DS-ce5059d2-7b2b-49a3-be85-017b2f074355 node DatanodeRegistration(127.0.0.1:38055, datanodeUuid=cc8b44d1-9bc0-4abf-ad2e-c763ae414b4d, infoPort=35991, infoSecurePort=0, ipcPort=45239, storageInfo=lv=-57;cid=testClusterID;nsid=1390561497;c=1694754050539), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 05:00:53,257 DEBUG [Listener at localhost/44249] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff 2023-09-15 05:00:53,344 INFO [Listener at localhost/44249] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/zookeeper_0, clientPort=60709, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-15 05:00:53,370 INFO [Listener at localhost/44249] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60709 2023-09-15 05:00:53,381 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:53,383 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:54,064 INFO [Listener at localhost/44249] util.FSUtils(471): Created version file at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 with version=8 2023-09-15 05:00:54,064 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/hbase-staging 2023-09-15 05:00:54,440 INFO [Listener at localhost/44249] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-15 05:00:54,909 INFO [Listener at localhost/44249] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 05:00:54,942 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:54,943 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:54,943 INFO [Listener at localhost/44249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 05:00:54,943 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:54,943 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 05:00:55,096 INFO [Listener at localhost/44249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 05:00:55,169 DEBUG [Listener at localhost/44249] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-15 05:00:55,263 INFO [Listener at localhost/44249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44181 2023-09-15 05:00:55,276 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,278 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,301 INFO [Listener at localhost/44249] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44181 connecting to ZooKeeper ensemble=127.0.0.1:60709 2023-09-15 05:00:55,357 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:441810x0, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 05:00:55,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44181-0x100adf5d4710000 connected 2023-09-15 05:00:55,393 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 05:00:55,393 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:00:55,407 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 05:00:55,415 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44181 2023-09-15 05:00:55,415 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44181 2023-09-15 05:00:55,416 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44181 2023-09-15 05:00:55,417 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44181 2023-09-15 05:00:55,417 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44181 2023-09-15 05:00:55,423 INFO [Listener at localhost/44249] master.HMaster(444): hbase.rootdir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, hbase.cluster.distributed=false 2023-09-15 05:00:55,487 INFO [Listener at localhost/44249] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 05:00:55,487 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,487 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,487 INFO [Listener at localhost/44249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 05:00:55,487 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,487 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 05:00:55,492 INFO [Listener at localhost/44249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 05:00:55,495 INFO [Listener at localhost/44249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36615 2023-09-15 05:00:55,498 INFO [Listener at localhost/44249] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 05:00:55,504 INFO [Listener at localhost/44249] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 05:00:55,506 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,507 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,510 INFO [Listener at localhost/44249] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36615 connecting to ZooKeeper ensemble=127.0.0.1:60709 2023-09-15 05:00:55,513 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:366150x0, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 05:00:55,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36615-0x100adf5d4710001 connected 2023-09-15 05:00:55,515 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 05:00:55,516 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:00:55,517 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 05:00:55,517 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36615 2023-09-15 05:00:55,517 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36615 2023-09-15 05:00:55,521 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36615 2023-09-15 05:00:55,522 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36615 2023-09-15 05:00:55,522 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36615 2023-09-15 05:00:55,535 INFO [Listener at localhost/44249] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 05:00:55,535 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,535 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,536 INFO [Listener at localhost/44249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 05:00:55,536 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,536 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 05:00:55,536 INFO [Listener at localhost/44249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 05:00:55,538 INFO [Listener at localhost/44249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35769 2023-09-15 05:00:55,538 INFO [Listener at localhost/44249] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 05:00:55,540 INFO [Listener at localhost/44249] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 05:00:55,541 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,543 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,546 INFO [Listener at localhost/44249] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35769 connecting to ZooKeeper ensemble=127.0.0.1:60709 2023-09-15 05:00:55,551 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:357690x0, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 05:00:55,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35769-0x100adf5d4710002 connected 2023-09-15 05:00:55,553 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 05:00:55,554 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:00:55,554 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 05:00:55,557 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35769 2023-09-15 05:00:55,557 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35769 2023-09-15 05:00:55,558 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35769 2023-09-15 05:00:55,558 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35769 2023-09-15 05:00:55,559 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35769 2023-09-15 05:00:55,571 INFO [Listener at localhost/44249] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 05:00:55,571 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,571 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,571 INFO [Listener at localhost/44249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 05:00:55,572 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 05:00:55,572 INFO [Listener at localhost/44249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 05:00:55,572 INFO [Listener at localhost/44249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 05:00:55,573 INFO [Listener at localhost/44249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45061 2023-09-15 05:00:55,574 INFO [Listener at localhost/44249] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 05:00:55,577 INFO [Listener at localhost/44249] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 05:00:55,578 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,580 INFO [Listener at localhost/44249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,583 INFO [Listener at localhost/44249] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45061 connecting to ZooKeeper ensemble=127.0.0.1:60709 2023-09-15 05:00:55,586 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:450610x0, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 05:00:55,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45061-0x100adf5d4710003 connected 2023-09-15 05:00:55,587 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 05:00:55,588 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:00:55,589 DEBUG [Listener at localhost/44249] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 05:00:55,589 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45061 2023-09-15 05:00:55,589 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45061 2023-09-15 05:00:55,594 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45061 2023-09-15 05:00:55,594 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45061 2023-09-15 05:00:55,597 DEBUG [Listener at localhost/44249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45061 2023-09-15 05:00:55,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:55,607 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-15 05:00:55,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:55,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 05:00:55,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 05:00:55,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 05:00:55,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 05:00:55,628 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:55,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-15 05:00:55,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-15 05:00:55,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44181,1694754054269 from backup master directory 2023-09-15 05:00:55,636 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:55,636 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-15 05:00:55,636 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 05:00:55,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:55,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-15 05:00:55,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-15 05:00:55,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/hbase.id with ID: 386ab5b9-b12f-4ba2-9a87-fbb8db8267bd 2023-09-15 05:00:55,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 05:00:55,792 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:55,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6e4b2947 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:00:55,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58231ece, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:00:55,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-15 05:00:55,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-15 05:00:55,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-15 05:00:55,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-15 05:00:55,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-15 05:00:55,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-15 05:00:55,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 05:00:55,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store-tmp 2023-09-15 05:00:56,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:56,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-15 05:00:56,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:00:56,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:00:56,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-15 05:00:56,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:00:56,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:00:56,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 05:00:56,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/WALs/jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:56,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44181%2C1694754054269, suffix=, logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/WALs/jenkins-hbase4.apache.org,44181,1694754054269, archiveDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/oldWALs, maxLogs=10 2023-09-15 05:00:56,091 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK] 2023-09-15 05:00:56,091 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK] 2023-09-15 05:00:56,091 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK] 2023-09-15 05:00:56,101 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-15 05:00:56,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/WALs/jenkins-hbase4.apache.org,44181,1694754054269/jenkins-hbase4.apache.org%2C44181%2C1694754054269.1694754056046 2023-09-15 05:00:56,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK], DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK], DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK]] 2023-09-15 05:00:56,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-15 05:00:56,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:56,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 05:00:56,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 05:00:56,231 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-15 05:00:56,238 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-15 05:00:56,265 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-15 05:00:56,280 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:56,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-15 05:00:56,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-15 05:00:56,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 05:00:56,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:00:56,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67573429, jitterRate=0.006922557950019836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:00:56,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 05:00:56,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-15 05:00:56,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-15 05:00:56,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-15 05:00:56,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-15 05:00:56,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-15 05:00:56,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-15 05:00:56,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-15 05:00:56,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-15 05:00:56,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-15 05:00:56,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-15 05:00:56,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-15 05:00:56,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-15 05:00:56,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-15 05:00:56,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-15 05:00:56,459 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:56,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-15 05:00:56,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-15 05:00:56,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-15 05:00:56,480 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 05:00:56,480 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 05:00:56,480 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 05:00:56,480 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 05:00:56,480 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:56,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44181,1694754054269, sessionid=0x100adf5d4710000, setting cluster-up flag (Was=false) 2023-09-15 05:00:56,498 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:56,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-15 05:00:56,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:56,512 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:56,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-15 05:00:56,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:56,523 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp 2023-09-15 05:00:56,601 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(951): ClusterId : 386ab5b9-b12f-4ba2-9a87-fbb8db8267bd 2023-09-15 05:00:56,603 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(951): ClusterId : 386ab5b9-b12f-4ba2-9a87-fbb8db8267bd 2023-09-15 05:00:56,604 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(951): ClusterId : 386ab5b9-b12f-4ba2-9a87-fbb8db8267bd 2023-09-15 05:00:56,609 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 05:00:56,609 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 05:00:56,609 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 05:00:56,618 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 05:00:56,618 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 05:00:56,618 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 05:00:56,618 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 05:00:56,618 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 05:00:56,618 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 05:00:56,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-15 05:00:56,623 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 05:00:56,623 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 05:00:56,623 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 05:00:56,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:00:56,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-15 05:00:56,632 DEBUG [RS:0;jenkins-hbase4:36615] zookeeper.ReadOnlyZKClient(139): Connect 0x2d0215c5 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:00:56,632 DEBUG [RS:1;jenkins-hbase4:35769] zookeeper.ReadOnlyZKClient(139): Connect 0x1df79314 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:00:56,632 DEBUG [RS:2;jenkins-hbase4:45061] zookeeper.ReadOnlyZKClient(139): Connect 0x29f220cb to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:00:56,641 DEBUG [RS:0;jenkins-hbase4:36615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23c5ee15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:00:56,641 DEBUG [RS:0;jenkins-hbase4:36615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27fa7eb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 05:00:56,667 DEBUG [RS:1;jenkins-hbase4:35769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13307eda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:00:56,667 DEBUG [RS:2;jenkins-hbase4:45061] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2735cb85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:00:56,667 DEBUG [RS:1;jenkins-hbase4:35769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@170ff864, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 05:00:56,669 DEBUG [RS:2;jenkins-hbase4:45061] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6608c1be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 05:00:56,688 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35769 2023-09-15 05:00:56,692 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36615 2023-09-15 05:00:56,692 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45061 2023-09-15 05:00:56,693 INFO [RS:1;jenkins-hbase4:35769] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 05:00:56,693 INFO [RS:0;jenkins-hbase4:36615] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 05:00:56,693 INFO [RS:0;jenkins-hbase4:36615] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 05:00:56,693 INFO [RS:2;jenkins-hbase4:45061] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 05:00:56,693 INFO [RS:1;jenkins-hbase4:35769] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 05:00:56,694 INFO [RS:2;jenkins-hbase4:45061] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 05:00:56,694 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 05:00:56,694 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 05:00:56,694 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 05:00:56,694 INFO [RS:1;jenkins-hbase4:35769] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:00:56,695 INFO [RS:0;jenkins-hbase4:36615] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:00:56,695 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 05:00:56,695 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 05:00:56,695 INFO [RS:2;jenkins-hbase4:45061] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:00:56,695 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 05:00:56,698 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44181,1694754054269 with isa=jenkins-hbase4.apache.org/172.31.14.131:36615, startcode=1694754055486 2023-09-15 05:00:56,698 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44181,1694754054269 with isa=jenkins-hbase4.apache.org/172.31.14.131:45061, startcode=1694754055570 2023-09-15 05:00:56,698 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44181,1694754054269 with isa=jenkins-hbase4.apache.org/172.31.14.131:35769, startcode=1694754055535 2023-09-15 05:00:56,717 DEBUG [RS:0;jenkins-hbase4:36615] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 05:00:56,717 DEBUG [RS:1;jenkins-hbase4:35769] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 05:00:56,717 DEBUG [RS:2;jenkins-hbase4:45061] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 05:00:56,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-15 05:00:56,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 05:00:56,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 05:00:56,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 05:00:56,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 05:00:56,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-15 05:00:56,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 05:00:56,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694754086760 2023-09-15 05:00:56,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-15 05:00:56,766 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-15 05:00:56,767 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-15 05:00:56,772 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 05:00:56,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-15 05:00:56,778 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45285, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 05:00:56,778 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44225, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 05:00:56,778 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40771, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 05:00:56,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-15 05:00:56,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-15 05:00:56,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-15 05:00:56,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-15 05:00:56,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-15 05:00:56,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-15 05:00:56,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-15 05:00:56,787 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44181] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-15 05:00:56,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-15 05:00:56,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-15 05:00:56,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694754056792,5,FailOnTimeoutGroup] 2023-09-15 05:00:56,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694754056792,5,FailOnTimeoutGroup] 2023-09-15 05:00:56,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-15 05:00:56,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,801 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44181] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,806 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44181] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,807 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:00:56,807 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41743 2023-09-15 05:00:56,807 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 05:00:56,809 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:00:56,809 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41743 2023-09-15 05:00:56,809 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 05:00:56,818 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:00:56,820 DEBUG [RS:0;jenkins-hbase4:36615] zookeeper.ZKUtil(162): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,820 WARN [RS:0;jenkins-hbase4:36615] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 05:00:56,820 INFO [RS:0;jenkins-hbase4:36615] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 05:00:56,820 DEBUG [RS:2;jenkins-hbase4:45061] zookeeper.ZKUtil(162): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,820 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,820 WARN [RS:2;jenkins-hbase4:45061] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 05:00:56,824 INFO [RS:2;jenkins-hbase4:45061] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 05:00:56,825 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,825 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45061,1694754055570] 2023-09-15 05:00:56,826 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36615,1694754055486] 2023-09-15 05:00:56,837 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(2830): Master is not running yet 2023-09-15 05:00:56,837 WARN [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-15 05:00:56,838 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-15 05:00:56,839 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-15 05:00:56,839 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:00:56,842 DEBUG [RS:2;jenkins-hbase4:45061] zookeeper.ZKUtil(162): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,842 DEBUG [RS:0;jenkins-hbase4:36615] zookeeper.ZKUtil(162): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,844 DEBUG [RS:0;jenkins-hbase4:36615] zookeeper.ZKUtil(162): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,844 DEBUG [RS:2;jenkins-hbase4:45061] zookeeper.ZKUtil(162): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,863 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 05:00:56,863 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 05:00:56,865 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:56,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-15 05:00:56,869 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/info 2023-09-15 05:00:56,870 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-15 05:00:56,871 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:56,871 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-15 05:00:56,874 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/rep_barrier 2023-09-15 05:00:56,874 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-15 05:00:56,875 INFO [RS:0;jenkins-hbase4:36615] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 05:00:56,875 INFO [RS:2;jenkins-hbase4:45061] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 05:00:56,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:56,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-15 05:00:56,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/table 2023-09-15 05:00:56,879 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-15 05:00:56,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:56,882 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740 2023-09-15 05:00:56,883 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740 2023-09-15 05:00:56,889 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-15 05:00:56,904 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-15 05:00:56,907 INFO [RS:0;jenkins-hbase4:36615] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 05:00:56,907 INFO [RS:2;jenkins-hbase4:45061] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 05:00:56,909 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:00:56,910 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59779608, jitterRate=-0.1092144250869751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-15 05:00:56,910 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-15 05:00:56,911 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-15 05:00:56,911 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-15 05:00:56,911 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-15 05:00:56,911 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-15 05:00:56,911 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-15 05:00:56,919 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-15 05:00:56,919 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-15 05:00:56,920 INFO [RS:2;jenkins-hbase4:45061] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 05:00:56,920 INFO [RS:0;jenkins-hbase4:36615] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 05:00:56,920 INFO [RS:2;jenkins-hbase4:45061] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,921 INFO [RS:0;jenkins-hbase4:36615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,921 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 05:00:56,923 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 05:00:56,927 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-15 05:00:56,927 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-15 05:00:56,934 INFO [RS:2;jenkins-hbase4:45061] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,934 INFO [RS:0;jenkins-hbase4:36615] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,934 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,934 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,934 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,935 DEBUG [RS:2;jenkins-hbase4:45061] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,936 DEBUG [RS:0;jenkins-hbase4:36615] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,936 INFO [RS:0;jenkins-hbase4:36615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,937 INFO [RS:0;jenkins-hbase4:36615] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,937 INFO [RS:0;jenkins-hbase4:36615] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,938 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44181,1694754054269 with isa=jenkins-hbase4.apache.org/172.31.14.131:35769, startcode=1694754055535 2023-09-15 05:00:56,939 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44181] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:56,941 INFO [RS:2;jenkins-hbase4:45061] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,941 INFO [RS:2;jenkins-hbase4:45061] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,941 INFO [RS:2;jenkins-hbase4:45061] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,942 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:00:56,942 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41743 2023-09-15 05:00:56,942 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 05:00:56,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-15 05:00:56,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:00:56,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:00:56,945 DEBUG [RS:1;jenkins-hbase4:35769] zookeeper.ZKUtil(162): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:56,945 WARN [RS:1;jenkins-hbase4:35769] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 05:00:56,945 INFO [RS:1;jenkins-hbase4:35769] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 05:00:56,945 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35769,1694754055535] 2023-09-15 05:00:56,945 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:56,947 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:00:56,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:56,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:56,952 DEBUG [RS:1;jenkins-hbase4:35769] zookeeper.ZKUtil(162): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:56,952 DEBUG [RS:1;jenkins-hbase4:35769] zookeeper.ZKUtil(162): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:56,953 DEBUG [RS:1;jenkins-hbase4:35769] zookeeper.ZKUtil(162): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:56,957 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 05:00:56,957 INFO [RS:1;jenkins-hbase4:35769] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 05:00:56,965 INFO [RS:1;jenkins-hbase4:35769] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 05:00:56,965 INFO [RS:0;jenkins-hbase4:36615] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 05:00:56,965 INFO [RS:2;jenkins-hbase4:45061] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 05:00:56,969 INFO [RS:1;jenkins-hbase4:35769] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 05:00:56,969 INFO [RS:1;jenkins-hbase4:35769] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,970 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 05:00:56,971 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-15 05:00:56,974 INFO [RS:2;jenkins-hbase4:45061] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45061,1694754055570-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,974 INFO [RS:0;jenkins-hbase4:36615] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36615,1694754055486-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,978 INFO [RS:1;jenkins-hbase4:35769] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,979 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,979 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,979 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,979 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,979 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,979 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 05:00:56,979 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,980 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,980 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,980 DEBUG [RS:1;jenkins-hbase4:35769] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 05:00:56,980 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-15 05:00:56,987 INFO [RS:1;jenkins-hbase4:35769] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,988 INFO [RS:1;jenkins-hbase4:35769] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:56,988 INFO [RS:1;jenkins-hbase4:35769] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:57,002 INFO [RS:2;jenkins-hbase4:45061] regionserver.Replication(203): jenkins-hbase4.apache.org,45061,1694754055570 started 2023-09-15 05:00:57,002 INFO [RS:0;jenkins-hbase4:36615] regionserver.Replication(203): jenkins-hbase4.apache.org,36615,1694754055486 started 2023-09-15 05:00:57,002 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45061,1694754055570, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45061, sessionid=0x100adf5d4710003 2023-09-15 05:00:57,002 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36615,1694754055486, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36615, sessionid=0x100adf5d4710001 2023-09-15 05:00:57,002 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 05:00:57,002 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 05:00:57,002 DEBUG [RS:2;jenkins-hbase4:45061] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:57,002 DEBUG [RS:0;jenkins-hbase4:36615] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:57,003 DEBUG [RS:2;jenkins-hbase4:45061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45061,1694754055570' 2023-09-15 05:00:57,003 DEBUG [RS:0;jenkins-hbase4:36615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36615,1694754055486' 2023-09-15 05:00:57,003 DEBUG [RS:2;jenkins-hbase4:45061] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 05:00:57,003 DEBUG [RS:0;jenkins-hbase4:36615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 05:00:57,004 DEBUG [RS:0;jenkins-hbase4:36615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 05:00:57,004 DEBUG [RS:2;jenkins-hbase4:45061] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 05:00:57,005 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 05:00:57,005 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 05:00:57,005 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 05:00:57,005 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 05:00:57,005 DEBUG [RS:0;jenkins-hbase4:36615] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:57,005 DEBUG [RS:2;jenkins-hbase4:45061] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:57,006 DEBUG [RS:2;jenkins-hbase4:45061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45061,1694754055570' 2023-09-15 05:00:57,006 DEBUG [RS:2;jenkins-hbase4:45061] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:00:57,006 DEBUG [RS:0;jenkins-hbase4:36615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36615,1694754055486' 2023-09-15 05:00:57,006 DEBUG [RS:0;jenkins-hbase4:36615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:00:57,006 DEBUG [RS:2;jenkins-hbase4:45061] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:00:57,006 DEBUG [RS:0;jenkins-hbase4:36615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:00:57,007 INFO [RS:1;jenkins-hbase4:35769] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 05:00:57,007 INFO [RS:1;jenkins-hbase4:35769] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35769,1694754055535-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:57,007 DEBUG [RS:2;jenkins-hbase4:45061] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 05:00:57,007 INFO [RS:2;jenkins-hbase4:45061] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 05:00:57,008 INFO [RS:2;jenkins-hbase4:45061] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 05:00:57,008 DEBUG [RS:0;jenkins-hbase4:36615] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 05:00:57,008 INFO [RS:0;jenkins-hbase4:36615] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 05:00:57,008 INFO [RS:0;jenkins-hbase4:36615] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 05:00:57,020 INFO [RS:1;jenkins-hbase4:35769] regionserver.Replication(203): jenkins-hbase4.apache.org,35769,1694754055535 started 2023-09-15 05:00:57,020 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35769,1694754055535, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35769, sessionid=0x100adf5d4710002 2023-09-15 05:00:57,021 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 05:00:57,021 DEBUG [RS:1;jenkins-hbase4:35769] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:57,021 DEBUG [RS:1;jenkins-hbase4:35769] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35769,1694754055535' 2023-09-15 05:00:57,021 DEBUG [RS:1;jenkins-hbase4:35769] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 05:00:57,021 DEBUG [RS:1;jenkins-hbase4:35769] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 05:00:57,022 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 05:00:57,022 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 05:00:57,022 DEBUG [RS:1;jenkins-hbase4:35769] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:57,022 DEBUG [RS:1;jenkins-hbase4:35769] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35769,1694754055535' 2023-09-15 05:00:57,022 DEBUG [RS:1;jenkins-hbase4:35769] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:00:57,023 DEBUG [RS:1;jenkins-hbase4:35769] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:00:57,023 DEBUG [RS:1;jenkins-hbase4:35769] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 05:00:57,023 INFO [RS:1;jenkins-hbase4:35769] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 05:00:57,023 INFO [RS:1;jenkins-hbase4:35769] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 05:00:57,123 INFO [RS:0;jenkins-hbase4:36615] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36615%2C1694754055486, suffix=, logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,36615,1694754055486, archiveDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs, maxLogs=32 2023-09-15 05:00:57,123 INFO [RS:2;jenkins-hbase4:45061] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45061%2C1694754055570, suffix=, logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,45061,1694754055570, archiveDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs, maxLogs=32 2023-09-15 05:00:57,126 INFO [RS:1;jenkins-hbase4:35769] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35769%2C1694754055535, suffix=, logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,35769,1694754055535, archiveDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs, maxLogs=32 2023-09-15 05:00:57,133 DEBUG [jenkins-hbase4:44181] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-15 05:00:57,138 DEBUG [jenkins-hbase4:44181] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:00:57,149 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK] 2023-09-15 05:00:57,149 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK] 2023-09-15 05:00:57,150 DEBUG [jenkins-hbase4:44181] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:00:57,150 DEBUG [jenkins-hbase4:44181] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:00:57,153 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK] 2023-09-15 05:00:57,154 DEBUG [jenkins-hbase4:44181] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:00:57,154 DEBUG [jenkins-hbase4:44181] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:00:57,159 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK] 2023-09-15 05:00:57,163 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK] 2023-09-15 05:00:57,164 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36615,1694754055486, state=OPENING 2023-09-15 05:00:57,166 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK] 2023-09-15 05:00:57,173 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK] 2023-09-15 05:00:57,175 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK] 2023-09-15 05:00:57,176 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK] 2023-09-15 05:00:57,182 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-15 05:00:57,184 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:57,188 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-15 05:00:57,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:00:57,193 INFO [RS:2;jenkins-hbase4:45061] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,45061,1694754055570/jenkins-hbase4.apache.org%2C45061%2C1694754055570.1694754057128 2023-09-15 05:00:57,193 INFO [RS:0;jenkins-hbase4:36615] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,36615,1694754055486/jenkins-hbase4.apache.org%2C36615%2C1694754055486.1694754057128 2023-09-15 05:00:57,193 INFO [RS:1;jenkins-hbase4:35769] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,35769,1694754055535/jenkins-hbase4.apache.org%2C35769%2C1694754055535.1694754057128 2023-09-15 05:00:57,197 DEBUG [RS:2;jenkins-hbase4:45061] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK], DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK], DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK]] 2023-09-15 05:00:57,202 DEBUG [RS:1;jenkins-hbase4:35769] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK], DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK], DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK]] 2023-09-15 05:00:57,203 DEBUG [RS:0;jenkins-hbase4:36615] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK], DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK], DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK]] 2023-09-15 05:00:57,382 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:00:57,385 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 05:00:57,390 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 05:00:57,403 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-15 05:00:57,403 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 05:00:57,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36615%2C1694754055486.meta, suffix=.meta, logDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,36615,1694754055486, archiveDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs, maxLogs=32 2023-09-15 05:00:57,431 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK] 2023-09-15 05:00:57,432 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK] 2023-09-15 05:00:57,433 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK] 2023-09-15 05:00:57,451 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/WALs/jenkins-hbase4.apache.org,36615,1694754055486/jenkins-hbase4.apache.org%2C36615%2C1694754055486.meta.1694754057408.meta 2023-09-15 05:00:57,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38055,DS-21dc9955-891e-441b-93ef-6fb0e7c46e3f,DISK], DatanodeInfoWithStorage[127.0.0.1:42475,DS-dfa3d0b8-3233-4a20-acb8-5c562cb407c0,DISK], DatanodeInfoWithStorage[127.0.0.1:35417,DS-b1328d92-30c9-43e1-a7ae-b1025fb2b819,DISK]] 2023-09-15 05:00:57,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-15 05:00:57,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-15 05:00:57,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:00:57,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-15 05:00:57,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-15 05:00:57,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-15 05:00:57,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-15 05:00:57,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:57,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-15 05:00:57,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-15 05:00:57,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-15 05:00:57,480 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/info 2023-09-15 05:00:57,480 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/info 2023-09-15 05:00:57,481 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-15 05:00:57,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:57,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-15 05:00:57,484 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/rep_barrier 2023-09-15 05:00:57,484 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/rep_barrier 2023-09-15 05:00:57,484 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-15 05:00:57,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:57,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-15 05:00:57,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/table 2023-09-15 05:00:57,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/table 2023-09-15 05:00:57,488 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-15 05:00:57,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:57,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740 2023-09-15 05:00:57,493 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740 2023-09-15 05:00:57,497 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-15 05:00:57,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-15 05:00:57,501 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67793296, jitterRate=0.010198831558227539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-15 05:00:57,503 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-15 05:00:57,513 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694754057374 2023-09-15 05:00:57,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-15 05:00:57,532 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-15 05:00:57,538 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36615,1694754055486, state=OPEN 2023-09-15 05:00:57,549 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-15 05:00:57,549 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-15 05:00:57,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-15 05:00:57,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36615,1694754055486 in 357 msec 2023-09-15 05:00:57,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-15 05:00:57,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 617 msec 2023-09-15 05:00:57,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 938 msec 2023-09-15 05:00:57,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694754057582, completionTime=-1 2023-09-15 05:00:57,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-15 05:00:57,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-15 05:00:57,690 DEBUG [hconnection-0x9e64fc8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:00:57,693 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:00:57,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-15 05:00:57,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694754117713 2023-09-15 05:00:57,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694754177713 2023-09-15 05:00:57,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 130 msec 2023-09-15 05:00:57,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44181,1694754054269-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:57,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44181,1694754054269-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:57,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44181,1694754054269-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:57,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44181, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:57,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-15 05:00:57,743 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-15 05:00:57,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-15 05:00:57,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 05:00:57,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-15 05:00:57,766 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:00:57,770 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:00:57,792 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:57,795 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d empty. 2023-09-15 05:00:57,796 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:57,796 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-15 05:00:57,833 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-15 05:00:57,835 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 22649dbbdac5f57ee64ba73f5616a37d, NAME => 'hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:00:57,854 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:57,854 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 22649dbbdac5f57ee64ba73f5616a37d, disabling compactions & flushes 2023-09-15 05:00:57,854 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:00:57,854 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:00:57,854 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. after waiting 0 ms 2023-09-15 05:00:57,854 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:00:57,854 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:00:57,854 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 22649dbbdac5f57ee64ba73f5616a37d: 2023-09-15 05:00:57,859 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:00:57,874 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694754057861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754057861"}]},"ts":"1694754057861"} 2023-09-15 05:00:57,899 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-15 05:00:57,901 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:00:57,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754057902"}]},"ts":"1694754057902"} 2023-09-15 05:00:57,910 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-15 05:00:57,915 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:00:57,916 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:00:57,916 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:00:57,916 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:00:57,916 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:00:57,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=22649dbbdac5f57ee64ba73f5616a37d, ASSIGN}] 2023-09-15 05:00:57,922 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=22649dbbdac5f57ee64ba73f5616a37d, ASSIGN 2023-09-15 05:00:57,924 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=22649dbbdac5f57ee64ba73f5616a37d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45061,1694754055570; forceNewPlan=false, retain=false 2023-09-15 05:00:58,076 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 05:00:58,078 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=22649dbbdac5f57ee64ba73f5616a37d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:58,079 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694754058077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754058077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754058077"}]},"ts":"1694754058077"} 2023-09-15 05:00:58,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 22649dbbdac5f57ee64ba73f5616a37d, server=jenkins-hbase4.apache.org,45061,1694754055570}] 2023-09-15 05:00:58,241 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:58,242 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 05:00:58,245 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 05:00:58,251 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:00:58,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22649dbbdac5f57ee64ba73f5616a37d, NAME => 'hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.', STARTKEY => '', ENDKEY => ''} 2023-09-15 05:00:58,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. service=AccessControlService 2023-09-15 05:00:58,253 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:00:58,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:58,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:58,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:58,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:58,256 INFO [StoreOpener-22649dbbdac5f57ee64ba73f5616a37d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:58,258 DEBUG [StoreOpener-22649dbbdac5f57ee64ba73f5616a37d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/info 2023-09-15 05:00:58,259 DEBUG [StoreOpener-22649dbbdac5f57ee64ba73f5616a37d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/info 2023-09-15 05:00:58,259 INFO [StoreOpener-22649dbbdac5f57ee64ba73f5616a37d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22649dbbdac5f57ee64ba73f5616a37d columnFamilyName info 2023-09-15 05:00:58,260 INFO [StoreOpener-22649dbbdac5f57ee64ba73f5616a37d-1] regionserver.HStore(310): Store=22649dbbdac5f57ee64ba73f5616a37d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:58,262 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:58,264 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:58,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:00:58,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:00:58,273 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 22649dbbdac5f57ee64ba73f5616a37d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68144357, jitterRate=0.015430048108100891}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:00:58,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 22649dbbdac5f57ee64ba73f5616a37d: 2023-09-15 05:00:58,275 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d., pid=6, masterSystemTime=1694754058241 2023-09-15 05:00:58,279 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:00:58,280 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:00:58,281 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=22649dbbdac5f57ee64ba73f5616a37d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:00:58,282 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694754058281"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754058281"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754058281"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754058281"}]},"ts":"1694754058281"} 2023-09-15 05:00:58,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-15 05:00:58,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 22649dbbdac5f57ee64ba73f5616a37d, server=jenkins-hbase4.apache.org,45061,1694754055570 in 200 msec 2023-09-15 05:00:58,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-15 05:00:58,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=22649dbbdac5f57ee64ba73f5616a37d, ASSIGN in 371 msec 2023-09-15 05:00:58,295 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:00:58,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754058295"}]},"ts":"1694754058295"} 2023-09-15 05:00:58,298 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-15 05:00:58,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:00:58,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 545 msec 2023-09-15 05:00:58,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-15 05:00:58,368 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-15 05:00:58,368 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:00:58,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:00:58,393 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:00:58,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-15 05:00:58,425 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-15 05:00:58,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-09-15 05:00:58,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-15 05:00:58,451 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-15 05:00:58,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-09-15 05:00:58,466 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-15 05:00:58,469 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-15 05:00:58,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.832sec 2023-09-15 05:00:58,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-15 05:00:58,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-15 05:00:58,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-15 05:00:58,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44181,1694754054269-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-15 05:00:58,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44181,1694754054269-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-15 05:00:58,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 05:00:58,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-15 05:00:58,501 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:00:58,502 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:00:58,505 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-15 05:00:58,506 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6 empty. 2023-09-15 05:00:58,508 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,508 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-15 05:00:58,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 05:00:58,531 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-15 05:00:58,533 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 366fac7bd8b2048c34f7bba0d8da5df6, NAME => 'hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:00:58,541 DEBUG [Listener at localhost/44249] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3f5cbd to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:00:58,548 DEBUG [Listener at localhost/44249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d513f0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:00:58,567 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:58,568 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 366fac7bd8b2048c34f7bba0d8da5df6, disabling compactions & flushes 2023-09-15 05:00:58,568 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:00:58,568 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:00:58,568 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. after waiting 0 ms 2023-09-15 05:00:58,568 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:00:58,568 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:00:58,569 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 366fac7bd8b2048c34f7bba0d8da5df6: 2023-09-15 05:00:58,574 DEBUG [hconnection-0x719aedd4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:00:58,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:00:58,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694754058576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754058576"}]},"ts":"1694754058576"} 2023-09-15 05:00:58,579 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-15 05:00:58,580 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:00:58,581 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754058581"}]},"ts":"1694754058581"} 2023-09-15 05:00:58,583 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-15 05:00:58,588 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:00:58,589 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:00:58,589 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:00:58,589 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:00:58,590 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:00:58,590 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:00:58,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=366fac7bd8b2048c34f7bba0d8da5df6, ASSIGN}] 2023-09-15 05:00:58,592 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:00:58,592 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-15 05:00:58,592 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=366fac7bd8b2048c34f7bba0d8da5df6, ASSIGN 2023-09-15 05:00:58,593 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/test.cache.data in system properties and HBase conf 2023-09-15 05:00:58,593 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop.tmp.dir in system properties and HBase conf 2023-09-15 05:00:58,593 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop.log.dir in system properties and HBase conf 2023-09-15 05:00:58,593 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-15 05:00:58,593 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-15 05:00:58,593 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-15 05:00:58,593 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=366fac7bd8b2048c34f7bba0d8da5df6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35769,1694754055535; forceNewPlan=false, retain=false 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/nfs.dump.dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 05:00:58,594 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-15 05:00:58,595 INFO [Listener at localhost/44249] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-15 05:00:58,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 05:00:58,744 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 05:00:58,745 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=366fac7bd8b2048c34f7bba0d8da5df6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:58,746 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694754058745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754058745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754058745"}]},"ts":"1694754058745"} 2023-09-15 05:00:58,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 366fac7bd8b2048c34f7bba0d8da5df6, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:00:58,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 05:00:58,904 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:58,904 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 05:00:58,908 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 05:00:58,915 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:00:58,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 366fac7bd8b2048c34f7bba0d8da5df6, NAME => 'hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.', STARTKEY => '', ENDKEY => ''} 2023-09-15 05:00:58,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. service=AccessControlService 2023-09-15 05:00:58,916 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:00:58,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:00:58,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,919 INFO [StoreOpener-366fac7bd8b2048c34f7bba0d8da5df6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,922 DEBUG [StoreOpener-366fac7bd8b2048c34f7bba0d8da5df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/l 2023-09-15 05:00:58,922 DEBUG [StoreOpener-366fac7bd8b2048c34f7bba0d8da5df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/l 2023-09-15 05:00:58,922 INFO [StoreOpener-366fac7bd8b2048c34f7bba0d8da5df6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 366fac7bd8b2048c34f7bba0d8da5df6 columnFamilyName l 2023-09-15 05:00:58,923 INFO [StoreOpener-366fac7bd8b2048c34f7bba0d8da5df6-1] regionserver.HStore(310): Store=366fac7bd8b2048c34f7bba0d8da5df6/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:00:58,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,926 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:00:58,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:00:58,937 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 366fac7bd8b2048c34f7bba0d8da5df6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63862974, jitterRate=-0.04836753010749817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:00:58,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 366fac7bd8b2048c34f7bba0d8da5df6: 2023-09-15 05:00:58,939 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6., pid=11, masterSystemTime=1694754058904 2023-09-15 05:00:58,947 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:00:58,947 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:00:58,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=366fac7bd8b2048c34f7bba0d8da5df6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:00:58,949 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694754058948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754058948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754058948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754058948"}]},"ts":"1694754058948"} 2023-09-15 05:00:58,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-15 05:00:58,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 366fac7bd8b2048c34f7bba0d8da5df6, server=jenkins-hbase4.apache.org,35769,1694754055535 in 203 msec 2023-09-15 05:00:58,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-15 05:00:58,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=366fac7bd8b2048c34f7bba0d8da5df6, ASSIGN in 366 msec 2023-09-15 05:00:58,961 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:00:58,961 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754058961"}]},"ts":"1694754058961"} 2023-09-15 05:00:58,964 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-15 05:00:58,967 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:00:58,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 470 msec 2023-09-15 05:00:59,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 05:00:59,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-15 05:00:59,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-15 05:00:59,740 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:01:00,091 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:01:00,099 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43943_jobhistory____xavw1u/webapp 2023-09-15 05:01:00,261 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-15 05:01:00,261 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-15 05:01:00,261 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 05:01:00,264 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 05:01:00,351 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:00,686 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:00,971 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-15 05:01:01,005 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43943 2023-09-15 05:01:01,232 WARN [Listener at jenkins-hbase4.apache.org/37881] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:01:01,514 WARN [Listener at jenkins-hbase4.apache.org/37881] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 05:01:01,514 INFO [Listener at jenkins-hbase4.apache.org/37881] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:01:01,522 INFO [Listener at jenkins-hbase4.apache.org/37881] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41451_cluster____78h7yp/webapp 2023-09-15 05:01:01,593 INFO [Listener at jenkins-hbase4.apache.org/37881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 05:01:01,594 INFO [Listener at jenkins-hbase4.apache.org/37881] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-15 05:01:01,594 INFO [Listener at jenkins-hbase4.apache.org/37881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 05:01:01,594 INFO [Listener at jenkins-hbase4.apache.org/37881] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 05:01:01,605 INFO [Listener at jenkins-hbase4.apache.org/37881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:01,778 INFO [Listener at jenkins-hbase4.apache.org/37881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:01,858 INFO [Listener at jenkins-hbase4.apache.org/37881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:01,865 INFO [Listener at jenkins-hbase4.apache.org/37881] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41451 2023-09-15 05:01:02,376 WARN [Listener at jenkins-hbase4.apache.org/40887] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:01:02,402 WARN [Listener at jenkins-hbase4.apache.org/40887] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 05:01:02,402 INFO [Listener at jenkins-hbase4.apache.org/40887] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:01:02,412 INFO [Listener at jenkins-hbase4.apache.org/40887] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44889_node____jtt0xj/webapp 2023-09-15 05:01:02,471 INFO [Listener at jenkins-hbase4.apache.org/40887] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-15 05:01:02,471 INFO [Listener at jenkins-hbase4.apache.org/40887] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 05:01:02,471 INFO [Listener at jenkins-hbase4.apache.org/40887] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 05:01:02,472 INFO [Listener at jenkins-hbase4.apache.org/40887] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 05:01:02,482 INFO [Listener at jenkins-hbase4.apache.org/40887] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:02,540 INFO [Listener at jenkins-hbase4.apache.org/40887] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:02,624 INFO [Listener at jenkins-hbase4.apache.org/40887] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:02,633 INFO [Listener at jenkins-hbase4.apache.org/40887] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44889 2023-09-15 05:01:02,784 WARN [Listener at jenkins-hbase4.apache.org/33501] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 05:01:02,791 WARN [Listener at jenkins-hbase4.apache.org/33501] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 05:01:02,791 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 05:01:02,798 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33831_node____.66x8cs/webapp 2023-09-15 05:01:02,848 INFO [Listener at jenkins-hbase4.apache.org/33501] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-15 05:01:02,848 INFO [Listener at jenkins-hbase4.apache.org/33501] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 05:01:02,848 INFO [Listener at jenkins-hbase4.apache.org/33501] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 05:01:02,848 INFO [Listener at jenkins-hbase4.apache.org/33501] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 05:01:02,855 INFO [Listener at jenkins-hbase4.apache.org/33501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:02,868 INFO [Listener at jenkins-hbase4.apache.org/33501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:02,935 INFO [Listener at jenkins-hbase4.apache.org/33501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 05:01:02,943 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33831 2023-09-15 05:01:02,970 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-15 05:01:02,972 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:01:03,030 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:01:03,040 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=165, AvailableMemoryMB=9548 2023-09-15 05:01:03,042 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-15 05:01:03,073 DEBUG [Listener at jenkins-hbase4.apache.org/33501] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-15 05:01:03,081 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-15 05:01:03,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 05:01:03,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:03,095 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:01:03,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-15 05:01:03,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 05:01:03,103 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:01:03,110 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,122 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444 empty. 2023-09-15 05:01:03,122 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,124 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,124 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00 empty. 2023-09-15 05:01:03,125 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,125 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-15 05:01:03,171 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-15 05:01:03,175 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e13ed1f80b03b9d2ad79dba61e422444, NAME => 'testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:01:03,181 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => d1576623e303ef649226b00e89409a00, NAME => 'testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:01:03,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 05:01:03,232 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-15 05:01:03,240 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-15 05:01:03,240 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:03,240 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e13ed1f80b03b9d2ad79dba61e422444, disabling compactions & flushes 2023-09-15 05:01:03,240 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:03,240 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:03,240 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. after waiting 0 ms 2023-09-15 05:01:03,240 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:03,240 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:03,240 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e13ed1f80b03b9d2ad79dba61e422444: 2023-09-15 05:01:03,241 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-15 05:01:03,247 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:03,247 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing d1576623e303ef649226b00e89409a00, disabling compactions & flushes 2023-09-15 05:01:03,247 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:03,247 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:03,247 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. after waiting 0 ms 2023-09-15 05:01:03,247 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:03,247 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:03,248 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for d1576623e303ef649226b00e89409a00: 2023-09-15 05:01:03,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:01:03,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754063253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754063253"}]},"ts":"1694754063253"} 2023-09-15 05:01:03,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754063253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754063253"}]},"ts":"1694754063253"} 2023-09-15 05:01:03,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 05:01:03,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:01:03,302 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754063302"}]},"ts":"1694754063302"} 2023-09-15 05:01:03,304 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-15 05:01:03,309 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:01:03,311 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:01:03,311 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:01:03,311 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:01:03,311 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:01:03,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e13ed1f80b03b9d2ad79dba61e422444, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1576623e303ef649226b00e89409a00, ASSIGN}] 2023-09-15 05:01:03,314 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e13ed1f80b03b9d2ad79dba61e422444, ASSIGN 2023-09-15 05:01:03,314 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1576623e303ef649226b00e89409a00, ASSIGN 2023-09-15 05:01:03,315 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1576623e303ef649226b00e89409a00, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45061,1694754055570; forceNewPlan=false, retain=false 2023-09-15 05:01:03,315 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e13ed1f80b03b9d2ad79dba61e422444, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36615,1694754055486; forceNewPlan=false, retain=false 2023-09-15 05:01:03,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 05:01:03,466 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 05:01:03,468 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d1576623e303ef649226b00e89409a00, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:03,468 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e13ed1f80b03b9d2ad79dba61e422444, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:03,468 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754063468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754063468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754063468"}]},"ts":"1694754063468"} 2023-09-15 05:01:03,468 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754063468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754063468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754063468"}]},"ts":"1694754063468"} 2023-09-15 05:01:03,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure d1576623e303ef649226b00e89409a00, server=jenkins-hbase4.apache.org,45061,1694754055570}] 2023-09-15 05:01:03,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure e13ed1f80b03b9d2ad79dba61e422444, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:01:03,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:03,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1576623e303ef649226b00e89409a00, NAME => 'testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 05:01:03,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. service=AccessControlService 2023-09-15 05:01:03,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:03,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e13ed1f80b03b9d2ad79dba61e422444, NAME => 'testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. service=AccessControlService 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:03,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,640 INFO [StoreOpener-d1576623e303ef649226b00e89409a00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,642 INFO [StoreOpener-e13ed1f80b03b9d2ad79dba61e422444-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,643 DEBUG [StoreOpener-d1576623e303ef649226b00e89409a00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf 2023-09-15 05:01:03,643 DEBUG [StoreOpener-d1576623e303ef649226b00e89409a00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf 2023-09-15 05:01:03,644 DEBUG [StoreOpener-e13ed1f80b03b9d2ad79dba61e422444-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf 2023-09-15 05:01:03,644 DEBUG [StoreOpener-e13ed1f80b03b9d2ad79dba61e422444-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf 2023-09-15 05:01:03,647 INFO [StoreOpener-d1576623e303ef649226b00e89409a00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1576623e303ef649226b00e89409a00 columnFamilyName cf 2023-09-15 05:01:03,647 INFO [StoreOpener-e13ed1f80b03b9d2ad79dba61e422444-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13ed1f80b03b9d2ad79dba61e422444 columnFamilyName cf 2023-09-15 05:01:03,650 INFO [StoreOpener-e13ed1f80b03b9d2ad79dba61e422444-1] regionserver.HStore(310): Store=e13ed1f80b03b9d2ad79dba61e422444/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:01:03,650 INFO [StoreOpener-d1576623e303ef649226b00e89409a00-1] regionserver.HStore(310): Store=d1576623e303ef649226b00e89409a00/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:01:03,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d1576623e303ef649226b00e89409a00 2023-09-15 05:01:03,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:03,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:01:03,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:01:03,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e13ed1f80b03b9d2ad79dba61e422444; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63795455, jitterRate=-0.04937364161014557}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:01:03,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e13ed1f80b03b9d2ad79dba61e422444: 2023-09-15 05:01:03,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d1576623e303ef649226b00e89409a00; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63795537, jitterRate=-0.04937241971492767}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:01:03,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d1576623e303ef649226b00e89409a00: 2023-09-15 05:01:03,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00., pid=15, masterSystemTime=1694754063629 2023-09-15 05:01:03,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444., pid=16, masterSystemTime=1694754063631 2023-09-15 05:01:03,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:03,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:03,672 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d1576623e303ef649226b00e89409a00, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:03,673 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754063672"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754063672"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754063672"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754063672"}]},"ts":"1694754063672"} 2023-09-15 05:01:03,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:03,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:03,674 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e13ed1f80b03b9d2ad79dba61e422444, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:03,677 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754063674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754063674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754063674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754063674"}]},"ts":"1694754063674"} 2023-09-15 05:01:03,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-15 05:01:03,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure d1576623e303ef649226b00e89409a00, server=jenkins-hbase4.apache.org,45061,1694754055570 in 207 msec 2023-09-15 05:01:03,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-15 05:01:03,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure e13ed1f80b03b9d2ad79dba61e422444, server=jenkins-hbase4.apache.org,36615,1694754055486 in 202 msec 2023-09-15 05:01:03,686 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1576623e303ef649226b00e89409a00, ASSIGN in 371 msec 2023-09-15 05:01:03,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-15 05:01:03,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e13ed1f80b03b9d2ad79dba61e422444, ASSIGN in 374 msec 2023-09-15 05:01:03,689 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:01:03,690 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754063689"}]},"ts":"1694754063689"} 2023-09-15 05:01:03,691 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-15 05:01:03,695 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:01:03,703 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-15 05:01:03,708 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:03,711 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:03,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 05:01:03,715 DEBUG [hconnection-0x179ad245-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:03,717 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-15 05:01:03,725 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 05:01:03,754 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:03,754 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:03,754 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:03,754 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:03,755 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:01:03,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:03,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:03,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:03,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:03,768 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 676 msec 2023-09-15 05:01:04,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 05:01:04,215 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-15 05:01:04,220 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-15 05:01:04,221 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:04,224 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:01:04,250 DEBUG [hconnection-0x719aedd4-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:04,254 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:04,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 05:01:04,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754064268 (current time:1694754064268). 2023-09-15 05:01:04,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:01:04,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x0e5cd97c to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:04,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4583b00f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:04,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:04,279 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:04,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e5cd97c to 127.0.0.1:60709 2023-09-15 05:01:04,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:04,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x7230d75e to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:04,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63706871, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:04,290 DEBUG [hconnection-0x4fda97b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:04,291 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:04,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:04,297 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:04,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7230d75e to 127.0.0.1:60709 2023-09-15 05:01:04,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:04,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 05:01:04,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:01:04,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 05:01:04,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 05:01:04,352 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 05:01:04,353 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694754664353 2023-09-15 05:01:04,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 05:01:04,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-15 05:01:04,358 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 05:01:04,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 05:01:04,360 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:01:04,360 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:01:04,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-09-15 05:01:04,361 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 05:01:04,362 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694754664362 2023-09-15 05:01:04,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,383 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-15 05:01:04,383 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,384 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-15 05:01:04,384 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-15 05:01:04,385 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,385 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,392 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,392 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,392 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,392 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,392 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,392 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,393 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,393 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:01:04,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 05:01:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 05:01:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 05:01:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 05:01:04,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 05:01:04,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 05:01:04,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 05:01:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 05:01:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 05:01:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 05:01:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 05:01:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 05:01:04,403 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 05:01:04,403 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 05:01:04,403 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 05:01:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,404 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 05:01:04,404 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 05:01:04,404 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 05:01:04,406 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,406 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,406 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,406 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,406 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:04,406 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:04,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-15 05:01:04,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45409d1d[Count = 1] remaining members to acquire global barrier 2023-09-15 05:01:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:04,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-15 05:01:04,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45409d1d[Count = 0] remaining members to acquire global barrier 2023-09-15 05:01:04,413 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-15 05:01:04,413 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,416 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,416 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 05:01:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 05:01:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 05:01:04,416 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:01:04,417 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,417 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:01:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:04,421 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,421 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:04,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 05:01:04,421 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. started... 2023-09-15 05:01:04,423 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:04,423 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:04,423 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:04,423 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. started... 2023-09-15 05:01:04,423 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 05:01:04,423 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 05:01:04,426 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1576623e303ef649226b00e89409a00: 2023-09-15 05:01:04,426 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e13ed1f80b03b9d2ad79dba61e422444: 2023-09-15 05:01:04,427 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,427 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,432 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:04,432 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:04,434 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:01:04,434 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-15 05:01:04,435 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:01:04,435 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-15 05:01:04,435 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-15 05:01:04,435 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-15 05:01:04,435 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:01:04,435 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-15 05:01:04,435 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-15 05:01:04,435 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-15 05:01:04,436 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:01:04,436 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:01:04,464 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:04,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 05:01:04,480 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. completed. 2023-09-15 05:01:04,480 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:04,480 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:04,481 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:04,481 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,481 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 05:01:04,481 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:01:04,481 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. completed. 2023-09-15 05:01:04,482 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:04,482 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:04,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:01:04,482 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:04,482 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,482 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 05:01:04,482 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:01:04,482 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:01:04,483 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 05:01:04,483 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,483 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:04,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:04,483 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 05:01:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:04,485 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 05:01:04,485 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:04,485 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,486 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 05:01:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45061,1694754055570': 2023-09-15 05:01:04,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-15 05:01:04,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:04,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:04,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:04,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:04,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:01:04,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-15 05:01:04,495 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-15 05:01:04,495 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:01:04,495 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:01:04,495 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,495 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:01:04,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:04,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:04,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:04,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:04,500 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:04,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:04,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:04,500 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:04,501 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,503 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:04,504 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,504 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,517 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:04,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:04,517 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:04,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-15 05:01:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:04,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:01:04,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:04,519 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,520 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 05:01:04,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-15 05:01:04,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,590 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:04,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694754064354Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694754064534 (+180 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694754064534Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694754064535 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694754064548 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694754064575 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694754064589 (+14 ms) 2023-09-15 05:01:04,592 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 05:01:04,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 234 msec 2023-09-15 05:01:04,683 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:04,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 05:01:04,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:01:04,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36615] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:01:04,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45061] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:01:04,706 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-15 05:01:04,706 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:04,706 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:01:04,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 05:01:04,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754064720 (current time:1694754064720). 2023-09-15 05:01:04,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:01:04,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x599d600a to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:04,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5020e6bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:04,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:04,731 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:04,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x599d600a to 127.0.0.1:60709 2023-09-15 05:01:04,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:04,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x66facb20 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:04,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54556ac5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:04,742 DEBUG [hconnection-0x3976bee-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:04,744 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:04,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:04,751 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:04,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66facb20 to 127.0.0.1:60709 2023-09-15 05:01:04,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:04,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 05:01:04,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:01:04,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 05:01:04,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 05:01:04,757 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 05:01:04,758 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694754664758 2023-09-15 05:01:04,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-15 05:01:04,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 05:01:04,759 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:01:04,759 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:01:04,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 05:01:04,762 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 05:01:04,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-15 05:01:04,764 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 05:01:04,765 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694754664765 2023-09-15 05:01:04,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-15 05:01:04,782 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-15 05:01:04,782 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,783 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-15 05:01:04,783 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-15 05:01:04,783 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,783 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,785 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,785 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,785 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,785 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:04,785 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,785 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,786 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,786 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,787 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 05:01:04,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 05:01:04,787 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 05:01:04,787 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 05:01:04,787 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 05:01:04,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 05:01:04,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 05:01:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 05:01:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 05:01:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 05:01:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 05:01:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:04,789 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 05:01:04,789 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 05:01:04,789 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 05:01:04,789 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 05:01:04,789 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 05:01:04,790 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 05:01:04,791 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,791 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:04,793 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,793 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-15 05:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@539ccaba[Count = 1] remaining members to acquire global barrier 2023-09-15 05:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-15 05:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@539ccaba[Count = 0] remaining members to acquire global barrier 2023-09-15 05:01:04,799 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-15 05:01:04,799 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,803 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,803 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,803 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 05:01:04,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,804 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 05:01:04,804 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:04,804 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:04,804 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. started... 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:04,804 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:04,805 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:01:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:01:04,804 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. started... 2023-09-15 05:01:04,805 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d1576623e303ef649226b00e89409a00 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-15 05:01:04,805 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e13ed1f80b03b9d2ad79dba61e422444 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-15 05:01:04,807 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 05:01:04,807 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:04,808 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 05:01:04,860 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:04,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 05:01:04,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:01:04,862 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:01:04,941 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091503352b14934f485c953667f0514e791e to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091503352b14934f485c953667f0514e791e 2023-09-15 05:01:04,941 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230915e911023bcd26457aa0d2186aa8eb0163 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915e911023bcd26457aa0d2186aa8eb0163 2023-09-15 05:01:04,974 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/.tmp/cf/ee8765c64e134b11813e478984b4785f 2023-09-15 05:01:04,984 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/.tmp/cf/220a7f9778264bbf98ee5e2e3540efb6 2023-09-15 05:01:04,986 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/.tmp/cf/ee8765c64e134b11813e478984b4785f as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf/ee8765c64e134b11813e478984b4785f 2023-09-15 05:01:04,995 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/.tmp/cf/220a7f9778264bbf98ee5e2e3540efb6 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf/220a7f9778264bbf98ee5e2e3540efb6 2023-09-15 05:01:04,997 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf/ee8765c64e134b11813e478984b4785f, entries=44, sequenceid=6, filesize=12.3 K 2023-09-15 05:01:05,004 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf/220a7f9778264bbf98ee5e2e3540efb6, entries=6, sequenceid=6, filesize=5.9 K 2023-09-15 05:01:05,006 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for d1576623e303ef649226b00e89409a00 in 199ms, sequenceid=6, compaction requested=false 2023-09-15 05:01:05,007 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-15 05:01:05,008 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1576623e303ef649226b00e89409a00: 2023-09-15 05:01:05,008 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e13ed1f80b03b9d2ad79dba61e422444 in 203ms, sequenceid=6, compaction requested=false 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e13ed1f80b03b9d2ad79dba61e422444: 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf/220a7f9778264bbf98ee5e2e3540efb6] hfiles 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf/220a7f9778264bbf98ee5e2e3540efb6 for snapshot=snaptb0-testExportWithTargetName 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf/ee8765c64e134b11813e478984b4785f] hfiles 2023-09-15 05:01:05,009 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf/ee8765c64e134b11813e478984b4785f for snapshot=snaptb0-testExportWithTargetName 2023-09-15 05:01:05,041 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. completed. 2023-09-15 05:01:05,042 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:05,042 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. completed. 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,042 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 05:01:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:01:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 05:01:05,044 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:05,044 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 05:01:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 05:01:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:05,045 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 05:01:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:05,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45061,1694754055570': 2023-09-15 05:01:05,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-15 05:01:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:05,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:05,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:05,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:05,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:05,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:05,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:01:05,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-15 05:01:05,055 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-15 05:01:05,056 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:01:05,056 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:01:05,056 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-15 05:01:05,056 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:01:05,058 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,058 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,058 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:05,058 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:05,058 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,058 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:05,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,059 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:05,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:05,059 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:05,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:05,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:05,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:05,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:05,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,060 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:05,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,061 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:05,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:05,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,062 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:05,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,063 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 05:01:05,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:05,063 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:01:05,064 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-15 05:01:05,064 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 05:01:05,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:05,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:05,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,078 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:05,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:05,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:05,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:05,078 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:05,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-15 05:01:05,078 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:05,078 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 05:01:05,078 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:05,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:05,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:05,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:05,077 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:05,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:05,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:01:05,078 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:05,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:05,079 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:05,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:05,080 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:05,080 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915e911023bcd26457aa0d2186aa8eb0163, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091503352b14934f485c953667f0514e791e] mob files 2023-09-15 05:01:05,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915e911023bcd26457aa0d2186aa8eb0163 2023-09-15 05:01:05,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091503352b14934f485c953667f0514e791e 2023-09-15 05:01:05,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-15 05:01:05,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-15 05:01:05,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 05:01:05,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694754064758Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694754065100 (+342 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694754065100Loading Region manifests for snaptb0-testExportWithTargetName at 1694754065100Writing data manifest for snaptb0-testExportWithTargetName at 1694754065105 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694754065128 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694754065140 (+12 ms) 2023-09-15 05:01:05,143 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 05:01:05,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 384 msec 2023-09-15 05:01:05,364 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:05,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 05:01:05,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:01:05,368 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368 2023-09-15 05:01:05,369 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41743, tgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368, rawTgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368, srcFsUri=hdfs://localhost:41743, srcDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:05,408 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:05,408 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-263351107_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-15 05:01:05,408 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, snapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-15 05:01:05,433 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-15 05:01:05,506 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:05,506 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:05,507 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:05,507 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,415 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-5662201012271063902.jar 2023-09-15 05:01:06,416 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,417 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,485 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-294625421330805159.jar 2023-09-15 05:01:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,487 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,487 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,488 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:06,488 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 05:01:06,489 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 05:01:06,489 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 05:01:06,489 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 05:01:06,490 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 05:01:06,490 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 05:01:06,491 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 05:01:06,492 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 05:01:06,492 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 05:01:06,493 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 05:01:06,498 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:06,499 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:06,499 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:06,500 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:06,500 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:06,501 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:06,502 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:07,322 WARN [Listener at jenkins-hbase4.apache.org/33501] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 05:01:07,329 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-15 05:01:07,340 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-15 05:01:07,796 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:07,798 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:08,139 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0001_000001 (auth:SIMPLE) 2023-09-15 05:01:09,143 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:01:12,340 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0001_000001 (auth:SIMPLE) 2023-09-15 05:01:14,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0001_000001 (auth:SIMPLE) 2023-09-15 05:01:18,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0001_000001 (auth:SIMPLE) 2023-09-15 05:01:19,246 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 05:01:19,249 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 05:01:19,260 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-15 05:01:19,260 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 05:01:19,261 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 05:01:19,261 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-15 05:01:19,262 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-15 05:01:19,262 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-15 05:01:19,262 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368/.hbase-snapshot/testExportWithTargetName 2023-09-15 05:01:19,263 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-15 05:01:19,263 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754065368/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-15 05:01:19,275 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-15 05:01:19,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-15 05:01:19,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:19,298 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754079298"}]},"ts":"1694754079298"} 2023-09-15 05:01:19,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 05:01:19,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-15 05:01:19,302 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-15 05:01:19,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e13ed1f80b03b9d2ad79dba61e422444, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1576623e303ef649226b00e89409a00, UNASSIGN}] 2023-09-15 05:01:19,307 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1576623e303ef649226b00e89409a00, UNASSIGN 2023-09-15 05:01:19,307 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e13ed1f80b03b9d2ad79dba61e422444, UNASSIGN 2023-09-15 05:01:19,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d1576623e303ef649226b00e89409a00, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:19,308 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754079308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754079308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754079308"}]},"ts":"1694754079308"} 2023-09-15 05:01:19,308 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e13ed1f80b03b9d2ad79dba61e422444, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:19,308 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754079308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754079308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754079308"}]},"ts":"1694754079308"} 2023-09-15 05:01:19,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure d1576623e303ef649226b00e89409a00, server=jenkins-hbase4.apache.org,45061,1694754055570}] 2023-09-15 05:01:19,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure e13ed1f80b03b9d2ad79dba61e422444, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:01:19,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 05:01:19,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:19,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d1576623e303ef649226b00e89409a00 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e13ed1f80b03b9d2ad79dba61e422444, disabling compactions & flushes 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d1576623e303ef649226b00e89409a00, disabling compactions & flushes 2023-09-15 05:01:19,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:19,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. after waiting 0 ms 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. after waiting 0 ms 2023-09-15 05:01:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:19,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:01:19,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:01:19,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:01:19,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:01:19,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444. 2023-09-15 05:01:19,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00. 2023-09-15 05:01:19,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e13ed1f80b03b9d2ad79dba61e422444: 2023-09-15 05:01:19,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d1576623e303ef649226b00e89409a00: 2023-09-15 05:01:19,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:19,494 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e13ed1f80b03b9d2ad79dba61e422444, regionState=CLOSED 2023-09-15 05:01:19,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d1576623e303ef649226b00e89409a00 2023-09-15 05:01:19,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754079494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754079494"}]},"ts":"1694754079494"} 2023-09-15 05:01:19,495 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d1576623e303ef649226b00e89409a00, regionState=CLOSED 2023-09-15 05:01:19,495 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694754079495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754079495"}]},"ts":"1694754079495"} 2023-09-15 05:01:19,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-15 05:01:19,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure e13ed1f80b03b9d2ad79dba61e422444, server=jenkins-hbase4.apache.org,36615,1694754055486 in 185 msec 2023-09-15 05:01:19,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-15 05:01:19,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e13ed1f80b03b9d2ad79dba61e422444, UNASSIGN in 195 msec 2023-09-15 05:01:19,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure d1576623e303ef649226b00e89409a00, server=jenkins-hbase4.apache.org,45061,1694754055570 in 187 msec 2023-09-15 05:01:19,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-15 05:01:19,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d1576623e303ef649226b00e89409a00, UNASSIGN in 197 msec 2023-09-15 05:01:19,504 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754079504"}]},"ts":"1694754079504"} 2023-09-15 05:01:19,506 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-15 05:01:19,507 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-15 05:01:19,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 223 msec 2023-09-15 05:01:19,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 05:01:19,603 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-15 05:01:19,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-15 05:01:19,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:19,617 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:19,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-15 05:01:19,619 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:19,623 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-15 05:01:19,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:19,626 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00 2023-09-15 05:01:19,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 05:01:19,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 05:01:19,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 05:01:19,627 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 05:01:19,629 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:19,629 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:19,629 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:19,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 05:01:19,629 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 05:01:19,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 05:01:19,629 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 05:01:19,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 05:01:19,629 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:19,629 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 05:01:19,629 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/recovered.edits] 2023-09-15 05:01:19,629 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/recovered.edits] 2023-09-15 05:01:19,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 05:01:19,631 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 05:01:19,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-15 05:01:19,638 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf/220a7f9778264bbf98ee5e2e3540efb6 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/cf/220a7f9778264bbf98ee5e2e3540efb6 2023-09-15 05:01:19,638 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf/ee8765c64e134b11813e478984b4785f to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/cf/ee8765c64e134b11813e478984b4785f 2023-09-15 05:01:19,642 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444/recovered.edits/9.seqid 2023-09-15 05:01:19,642 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00/recovered.edits/9.seqid 2023-09-15 05:01:19,642 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/e13ed1f80b03b9d2ad79dba61e422444 2023-09-15 05:01:19,643 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportWithTargetName/d1576623e303ef649226b00e89409a00 2023-09-15 05:01:19,643 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-15 05:01:19,643 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-15 05:01:19,644 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-15 05:01:19,648 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915e911023bcd26457aa0d2186aa8eb0163 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915e911023bcd26457aa0d2186aa8eb0163 2023-09-15 05:01:19,649 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091503352b14934f485c953667f0514e791e to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091503352b14934f485c953667f0514e791e 2023-09-15 05:01:19,649 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-15 05:01:19,652 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:19,673 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-15 05:01:19,676 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-15 05:01:19,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:19,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-15 05:01:19,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754079677"}]},"ts":"9223372036854775807"} 2023-09-15 05:01:19,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754079677"}]},"ts":"9223372036854775807"} 2023-09-15 05:01:19,679 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 05:01:19,679 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e13ed1f80b03b9d2ad79dba61e422444, NAME => 'testtb-testExportWithTargetName,,1694754063088.e13ed1f80b03b9d2ad79dba61e422444.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d1576623e303ef649226b00e89409a00, NAME => 'testtb-testExportWithTargetName,1,1694754063088.d1576623e303ef649226b00e89409a00.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 05:01:19,679 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-15 05:01:19,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694754079679"}]},"ts":"9223372036854775807"} 2023-09-15 05:01:19,681 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-15 05:01:19,684 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 05:01:19,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 75 msec 2023-09-15 05:01:19,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-15 05:01:19,735 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-15 05:01:19,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-15 05:01:19,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-15 05:01:19,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-15 05:01:19,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-15 05:01:19,788 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=757 (was 706) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:41967 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:40887 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:38414 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:33501 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-968996281_1 at /127.0.0.1:44238 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:44268 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:44598 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:35569 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=934 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 160) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=8738 (was 9548) 2023-09-15 05:01:19,789 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-15 05:01:19,807 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=233, ProcessCount=168, AvailableMemoryMB=8736 2023-09-15 05:01:19,808 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-15 05:01:19,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 05:01:19,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:19,815 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:01:19,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-15 05:01:19,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 05:01:19,817 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:01:19,820 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:19,820 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:19,821 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef empty. 2023-09-15 05:01:19,821 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc empty. 2023-09-15 05:01:19,821 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:19,821 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:19,821 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-15 05:01:19,834 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-15 05:01:19,835 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => ddf072ad2e5d273a58b60507463896ef, NAME => 'testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:01:19,836 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3eb87072f0c75fae5fefd6d4636ca7fc, NAME => 'testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:01:19,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:19,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:19,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 3eb87072f0c75fae5fefd6d4636ca7fc, disabling compactions & flushes 2023-09-15 05:01:19,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing ddf072ad2e5d273a58b60507463896ef, disabling compactions & flushes 2023-09-15 05:01:19,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:19,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. after waiting 0 ms 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:19,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. after waiting 0 ms 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 3eb87072f0c75fae5fefd6d4636ca7fc: 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:19,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:19,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for ddf072ad2e5d273a58b60507463896ef: 2023-09-15 05:01:19,870 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:01:19,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754079871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754079871"}]},"ts":"1694754079871"} 2023-09-15 05:01:19,872 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754079871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754079871"}]},"ts":"1694754079871"} 2023-09-15 05:01:19,874 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 05:01:19,875 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:01:19,876 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754079876"}]},"ts":"1694754079876"} 2023-09-15 05:01:19,877 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-15 05:01:19,881 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:01:19,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:01:19,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:01:19,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:01:19,883 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:01:19,883 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddf072ad2e5d273a58b60507463896ef, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3eb87072f0c75fae5fefd6d4636ca7fc, ASSIGN}] 2023-09-15 05:01:19,885 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3eb87072f0c75fae5fefd6d4636ca7fc, ASSIGN 2023-09-15 05:01:19,885 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddf072ad2e5d273a58b60507463896ef, ASSIGN 2023-09-15 05:01:19,886 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddf072ad2e5d273a58b60507463896ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36615,1694754055486; forceNewPlan=false, retain=false 2023-09-15 05:01:19,886 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3eb87072f0c75fae5fefd6d4636ca7fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35769,1694754055535; forceNewPlan=false, retain=false 2023-09-15 05:01:19,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 05:01:20,037 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 05:01:20,039 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ddf072ad2e5d273a58b60507463896ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,039 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3eb87072f0c75fae5fefd6d4636ca7fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754080039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754080039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754080039"}]},"ts":"1694754080039"} 2023-09-15 05:01:20,040 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754080039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754080039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754080039"}]},"ts":"1694754080039"} 2023-09-15 05:01:20,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure ddf072ad2e5d273a58b60507463896ef, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:01:20,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 3eb87072f0c75fae5fefd6d4636ca7fc, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:01:20,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 05:01:20,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ddf072ad2e5d273a58b60507463896ef, NAME => 'testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 05:01:20,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. service=AccessControlService 2023-09-15 05:01:20,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:20,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3eb87072f0c75fae5fefd6d4636ca7fc, NAME => 'testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 05:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. service=AccessControlService 2023-09-15 05:01:20,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:01:20,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:20,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:20,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:20,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:20,206 INFO [StoreOpener-ddf072ad2e5d273a58b60507463896ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:20,206 INFO [StoreOpener-3eb87072f0c75fae5fefd6d4636ca7fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:20,207 DEBUG [StoreOpener-ddf072ad2e5d273a58b60507463896ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf 2023-09-15 05:01:20,207 DEBUG [StoreOpener-ddf072ad2e5d273a58b60507463896ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf 2023-09-15 05:01:20,208 DEBUG [StoreOpener-3eb87072f0c75fae5fefd6d4636ca7fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf 2023-09-15 05:01:20,208 DEBUG [StoreOpener-3eb87072f0c75fae5fefd6d4636ca7fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf 2023-09-15 05:01:20,208 INFO [StoreOpener-ddf072ad2e5d273a58b60507463896ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddf072ad2e5d273a58b60507463896ef columnFamilyName cf 2023-09-15 05:01:20,208 INFO [StoreOpener-3eb87072f0c75fae5fefd6d4636ca7fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb87072f0c75fae5fefd6d4636ca7fc columnFamilyName cf 2023-09-15 05:01:20,210 INFO [StoreOpener-ddf072ad2e5d273a58b60507463896ef-1] regionserver.HStore(310): Store=ddf072ad2e5d273a58b60507463896ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:01:20,212 INFO [StoreOpener-3eb87072f0c75fae5fefd6d4636ca7fc-1] regionserver.HStore(310): Store=3eb87072f0c75fae5fefd6d4636ca7fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:01:20,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:20,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:20,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:20,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:20,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:20,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:20,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:01:20,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:01:20,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ddf072ad2e5d273a58b60507463896ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68095486, jitterRate=0.014701813459396362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:01:20,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3eb87072f0c75fae5fefd6d4636ca7fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62599923, jitterRate=-0.06718845665454865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:01:20,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ddf072ad2e5d273a58b60507463896ef: 2023-09-15 05:01:20,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3eb87072f0c75fae5fefd6d4636ca7fc: 2023-09-15 05:01:20,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef., pid=30, masterSystemTime=1694754080195 2023-09-15 05:01:20,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc., pid=31, masterSystemTime=1694754080195 2023-09-15 05:01:20,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:20,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:20,226 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3eb87072f0c75fae5fefd6d4636ca7fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754080226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754080226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754080226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754080226"}]},"ts":"1694754080226"} 2023-09-15 05:01:20,228 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ddf072ad2e5d273a58b60507463896ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,228 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754080227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754080227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754080227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754080227"}]},"ts":"1694754080227"} 2023-09-15 05:01:20,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-15 05:01:20,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 3eb87072f0c75fae5fefd6d4636ca7fc, server=jenkins-hbase4.apache.org,35769,1694754055535 in 187 msec 2023-09-15 05:01:20,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-15 05:01:20,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure ddf072ad2e5d273a58b60507463896ef, server=jenkins-hbase4.apache.org,36615,1694754055486 in 191 msec 2023-09-15 05:01:20,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3eb87072f0c75fae5fefd6d4636ca7fc, ASSIGN in 354 msec 2023-09-15 05:01:20,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-15 05:01:20,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddf072ad2e5d273a58b60507463896ef, ASSIGN in 356 msec 2023-09-15 05:01:20,243 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:01:20,243 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754080243"}]},"ts":"1694754080243"} 2023-09-15 05:01:20,244 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-15 05:01:20,247 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:01:20,247 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-15 05:01:20,249 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 05:01:20,251 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:20,251 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:20,251 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:20,251 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:20,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:20,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:20,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:20,253 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:20,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 441 msec 2023-09-15 05:01:20,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 05:01:20,421 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-15 05:01:20,424 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-15 05:01:20,424 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,426 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:01:20,435 DEBUG [hconnection-0x719aedd4-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:20,441 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:20,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:01:20,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754080444 (current time:1694754080444). 2023-09-15 05:01:20,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:01:20,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x6a6c0fa9 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:20,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9dadb8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:20,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:20,454 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:20,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a6c0fa9 to 127.0.0.1:60709 2023-09-15 05:01:20,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:20,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x4b7a74e4 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:20,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41613b65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:20,463 DEBUG [hconnection-0x1eb8ae48-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:20,465 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:20,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:20,469 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:20,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b7a74e4 to 127.0.0.1:60709 2023-09-15 05:01:20,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:20,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 05:01:20,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:01:20,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:01:20,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:01:20,476 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:01:20,477 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694754680477 2023-09-15 05:01:20,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:01:20,477 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-15 05:01:20,478 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:01:20,478 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:01:20,479 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:01:20,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 05:01:20,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-15 05:01:20,482 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 05:01:20,482 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694754680482 2023-09-15 05:01:20,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,495 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-15 05:01:20,495 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,496 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-15 05:01:20,496 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-15 05:01:20,497 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,497 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,499 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,499 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,500 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,500 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,500 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,500 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:01:20,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,501 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 05:01:20,501 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 05:01:20,501 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,501 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 05:01:20,503 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 05:01:20,503 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 05:01:20,503 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,503 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 05:01:20,503 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 05:01:20,503 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 05:01:20,503 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 05:01:20,501 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,504 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 05:01:20,504 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 05:01:20,504 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 05:01:20,506 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,506 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:20,512 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,512 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:20,512 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,513 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:20,512 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,513 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,513 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:20,513 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,513 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:20,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-15 05:01:20,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a1088e2[Count = 1] remaining members to acquire global barrier 2023-09-15 05:01:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:20,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-15 05:01:20,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a1088e2[Count = 0] remaining members to acquire global barrier 2023-09-15 05:01:20,517 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 05:01:20,517 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:01:20,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:20,518 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:20,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,518 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. started... 2023-09-15 05:01:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:01:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:01:20,519 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,519 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:01:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,519 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3eb87072f0c75fae5fefd6d4636ca7fc: 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. started... 2023-09-15 05:01:20,520 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:01:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:20,520 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddf072ad2e5d273a58b60507463896ef: 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:20,520 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:01:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 05:01:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 05:01:20,538 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. completed. 2023-09-15 05:01:20,538 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 05:01:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:01:20,541 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 05:01:20,541 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,541 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:20,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:20,541 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 05:01:20,543 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. completed. 2023-09-15 05:01:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:20,543 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,543 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:20,543 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:20,543 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,543 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 05:01:20,543 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:01:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,545 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 05:01:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 05:01:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:01:20,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 05:01:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:01:20,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 05:01:20,552 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-15 05:01:20,552 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:01:20,552 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:01:20,552 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,552 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:01:20,554 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:20,554 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:20,554 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:20,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:20,554 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:20,555 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,555 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:20,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:20,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:20,556 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,559 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,559 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,559 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:20,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,562 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:20,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,562 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:20,563 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:20,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:20,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:01:20,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:20,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:20,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:20,564 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,564 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,564 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,564 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,564 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:20,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 05:01:20,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,578 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:20,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 05:01:20,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:01:20,580 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:01:20,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-15 05:01:20,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,595 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:20,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694754080477Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694754080573 (+96 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694754080573Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694754080573Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694754080578 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694754080587 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694754080594 (+7 ms) 2023-09-15 05:01:20,597 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 05:01:20,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 119 msec 2023-09-15 05:01:20,780 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:20,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 05:01:20,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:01:20,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:01:20,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35769] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:01:20,791 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-15 05:01:20,791 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,792 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:01:20,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:01:20,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754080805 (current time:1694754080805). 2023-09-15 05:01:20,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:01:20,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x2c9d1223 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:20,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53042a41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:20,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:20,820 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:20,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c9d1223 to 127.0.0.1:60709 2023-09-15 05:01:20,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:20,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x0e5fd34e to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:20,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3833b99d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:20,834 DEBUG [hconnection-0x14a4122e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:20,835 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:20,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:20,841 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:20,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e5fd34e to 127.0.0.1:60709 2023-09-15 05:01:20,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:20,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 05:01:20,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:01:20,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:01:20,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:01:20,847 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:01:20,848 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694754680848 2023-09-15 05:01:20,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:01:20,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-15 05:01:20,849 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:01:20,849 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:01:20,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 05:01:20,851 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:01:20,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-15 05:01:20,853 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 05:01:20,854 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694754680854 2023-09-15 05:01:20,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-15 05:01:20,867 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-15 05:01:20,867 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,869 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-15 05:01:20,869 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-15 05:01:20,869 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,869 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,871 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,871 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,871 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,871 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:20,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:20,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:20,872 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,872 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,872 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,872 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:01:20,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 05:01:20,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 05:01:20,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 05:01:20,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 05:01:20,874 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 05:01:20,874 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,874 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 05:01:20,875 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 05:01:20,875 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 05:01:20,875 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,876 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 05:01:20,876 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 05:01:20,875 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 05:01:20,876 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 05:01:20,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 05:01:20,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 05:01:20,877 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 05:01:20,877 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:20,877 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 05:01:20,877 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 05:01:20,877 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 05:01:20,879 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:20,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:20,880 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:20,880 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,880 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:20,881 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:20,881 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:20,881 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,881 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:20,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:20,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-15 05:01:20,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@510301b7[Count = 1] remaining members to acquire global barrier 2023-09-15 05:01:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:20,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-15 05:01:20,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@510301b7[Count = 0] remaining members to acquire global barrier 2023-09-15 05:01:20,886 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 05:01:20,886 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:01:20,889 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:20,889 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:20,889 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. started... 2023-09-15 05:01:20,889 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,889 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:20,889 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:20,889 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. started... 2023-09-15 05:01:20,889 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3eb87072f0c75fae5fefd6d4636ca7fc 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-15 05:01:20,890 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ddf072ad2e5d273a58b60507463896ef 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-15 05:01:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 05:01:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 05:01:20,934 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309150da3c7e4277e4d728e73ade34be5ef39 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309150da3c7e4277e4d728e73ade34be5ef39 2023-09-15 05:01:20,942 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230915cb22bdb64b8749ac8987671992913b69 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb22bdb64b8749ac8987671992913b69 2023-09-15 05:01:20,949 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:20,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 05:01:20,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:01:20,951 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:01:20,957 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/.tmp/cf/c494ea7515e745cf9b19faf88f6f92b5 2023-09-15 05:01:20,964 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/.tmp/cf/c494ea7515e745cf9b19faf88f6f92b5 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf/c494ea7515e745cf9b19faf88f6f92b5 2023-09-15 05:01:20,968 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/.tmp/cf/32af8c26eafb4bfa891c920a653626f7 2023-09-15 05:01:20,971 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf/c494ea7515e745cf9b19faf88f6f92b5, entries=3, sequenceid=6, filesize=5.4 K 2023-09-15 05:01:20,972 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ddf072ad2e5d273a58b60507463896ef in 82ms, sequenceid=6, compaction requested=false 2023-09-15 05:01:20,972 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-15 05:01:20,972 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddf072ad2e5d273a58b60507463896ef: 2023-09-15 05:01:20,973 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 05:01:20,973 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:20,973 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf/c494ea7515e745cf9b19faf88f6f92b5] hfiles 2023-09-15 05:01:20,973 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf/c494ea7515e745cf9b19faf88f6f92b5 for snapshot=snaptb0-testExportFileSystemState 2023-09-15 05:01:20,980 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/.tmp/cf/32af8c26eafb4bfa891c920a653626f7 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf/32af8c26eafb4bfa891c920a653626f7 2023-09-15 05:01:20,987 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf/32af8c26eafb4bfa891c920a653626f7, entries=47, sequenceid=6, filesize=12.8 K 2023-09-15 05:01:20,988 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3eb87072f0c75fae5fefd6d4636ca7fc in 99ms, sequenceid=6, compaction requested=false 2023-09-15 05:01:20,993 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3eb87072f0c75fae5fefd6d4636ca7fc: 2023-09-15 05:01:20,993 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 05:01:20,993 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:20,994 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf/32af8c26eafb4bfa891c920a653626f7] hfiles 2023-09-15 05:01:20,994 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf/32af8c26eafb4bfa891c920a653626f7 for snapshot=snaptb0-testExportFileSystemState 2023-09-15 05:01:20,996 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. completed. 2023-09-15 05:01:20,996 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 05:01:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:01:21,001 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 05:01:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 05:01:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:01:21,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 05:01:21,011 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. completed. 2023-09-15 05:01:21,012 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 05:01:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:01:21,013 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,013 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 05:01:21,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:21,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:21,013 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 05:01:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:01:21,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 05:01:21,018 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-15 05:01:21,018 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:01:21,018 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:01:21,018 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-15 05:01:21,018 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:01:21,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:21,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:21,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:21,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:21,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:21,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:21,021 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:21,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,021 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,024 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,026 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:21,026 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 05:01:21,027 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:21,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:21,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,031 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-15 05:01:21,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:21,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-15 05:01:21,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:21,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:21,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:21,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:21,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:21,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:21,031 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:21,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:21,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:21,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:21,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:21,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb22bdb64b8749ac8987671992913b69, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309150da3c7e4277e4d728e73ade34be5ef39] mob files 2023-09-15 05:01:21,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb22bdb64b8749ac8987671992913b69 2023-09-15 05:01:21,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309150da3c7e4277e4d728e73ade34be5ef39 2023-09-15 05:01:21,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-15 05:01:21,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-15 05:01:21,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,090 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694754080848Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694754081043 (+195 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694754081043Loading Region manifests for snaptb0-testExportFileSystemState at 1694754081043Writing data manifest for snaptb0-testExportFileSystemState at 1694754081053 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694754081073 (+20 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694754081089 (+16 ms) 2023-09-15 05:01:21,093 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 05:01:21,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 244 msec 2023-09-15 05:01:21,151 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:21,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 05:01:21,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:01:21,152 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152 2023-09-15 05:01:21,153 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41743, tgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152, rawTgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152, srcFsUri=hdfs://localhost:41743, srcDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:21,182 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:21,182 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1765716419_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,182 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, snapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-15 05:01:21,200 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 05:01:21,232 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:21,232 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:21,232 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:21,233 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,151 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-1699395485766131517.jar 2023-09-15 05:01:22,151 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,152 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,218 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-5437581499710046147.jar 2023-09-15 05:01:22,219 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,219 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,220 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,220 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,221 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,221 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:22,221 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 05:01:22,222 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 05:01:22,222 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 05:01:22,223 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 05:01:22,223 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 05:01:22,223 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 05:01:22,224 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 05:01:22,224 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 05:01:22,224 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 05:01:22,225 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 05:01:22,226 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:22,226 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:22,227 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:22,227 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:22,227 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:22,228 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:22,229 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:22,689 WARN [Listener at jenkins-hbase4.apache.org/33501] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 05:01:22,692 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-15 05:01:22,694 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-15 05:01:24,222 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:24,222 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:24,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0001_000001 (auth:SIMPLE) 2023-09-15 05:01:24,999 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0002_000001 (auth:SIMPLE) 2023-09-15 05:01:25,075 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:01:29,139 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0002_000001 (auth:SIMPLE) 2023-09-15 05:01:31,361 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0002_000001 (auth:SIMPLE) 2023-09-15 05:01:34,467 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0002_000001 (auth:SIMPLE) 2023-09-15 05:01:35,894 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 05:01:35,895 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 05:01:35,903 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-15 05:01:35,904 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 05:01:35,904 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 05:01:35,904 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 05:01:35,905 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-15 05:01:35,905 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-15 05:01:35,905 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 05:01:35,905 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-15 05:01:35,905 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754081152/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-15 05:01:35,912 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-15 05:01:35,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-15 05:01:35,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:35,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 05:01:35,918 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754095918"}]},"ts":"1694754095918"} 2023-09-15 05:01:35,919 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-15 05:01:35,921 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-15 05:01:35,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddf072ad2e5d273a58b60507463896ef, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3eb87072f0c75fae5fefd6d4636ca7fc, UNASSIGN}] 2023-09-15 05:01:35,924 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddf072ad2e5d273a58b60507463896ef, UNASSIGN 2023-09-15 05:01:35,924 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3eb87072f0c75fae5fefd6d4636ca7fc, UNASSIGN 2023-09-15 05:01:35,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ddf072ad2e5d273a58b60507463896ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:35,925 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754095925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754095925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754095925"}]},"ts":"1694754095925"} 2023-09-15 05:01:35,927 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3eb87072f0c75fae5fefd6d4636ca7fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:35,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure ddf072ad2e5d273a58b60507463896ef, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:01:35,927 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754095927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754095927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754095927"}]},"ts":"1694754095927"} 2023-09-15 05:01:35,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 3eb87072f0c75fae5fefd6d4636ca7fc, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:01:36,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 05:01:36,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:36,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ddf072ad2e5d273a58b60507463896ef, disabling compactions & flushes 2023-09-15 05:01:36,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3eb87072f0c75fae5fefd6d4636ca7fc, disabling compactions & flushes 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:36,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. after waiting 0 ms 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. after waiting 0 ms 2023-09-15 05:01:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:36,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:01:36,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:01:36,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:01:36,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef. 2023-09-15 05:01:36,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ddf072ad2e5d273a58b60507463896ef: 2023-09-15 05:01:36,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:01:36,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc. 2023-09-15 05:01:36,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3eb87072f0c75fae5fefd6d4636ca7fc: 2023-09-15 05:01:36,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:36,096 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ddf072ad2e5d273a58b60507463896ef, regionState=CLOSED 2023-09-15 05:01:36,096 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754096095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754096095"}]},"ts":"1694754096095"} 2023-09-15 05:01:36,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:36,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3eb87072f0c75fae5fefd6d4636ca7fc, regionState=CLOSED 2023-09-15 05:01:36,097 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694754096096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754096096"}]},"ts":"1694754096096"} 2023-09-15 05:01:36,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-15 05:01:36,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure ddf072ad2e5d273a58b60507463896ef, server=jenkins-hbase4.apache.org,36615,1694754055486 in 170 msec 2023-09-15 05:01:36,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-15 05:01:36,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 3eb87072f0c75fae5fefd6d4636ca7fc, server=jenkins-hbase4.apache.org,35769,1694754055535 in 169 msec 2023-09-15 05:01:36,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddf072ad2e5d273a58b60507463896ef, UNASSIGN in 177 msec 2023-09-15 05:01:36,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-15 05:01:36,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3eb87072f0c75fae5fefd6d4636ca7fc, UNASSIGN in 178 msec 2023-09-15 05:01:36,103 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754096103"}]},"ts":"1694754096103"} 2023-09-15 05:01:36,104 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-15 05:01:36,106 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-15 05:01:36,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-15 05:01:36,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 05:01:36,220 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-15 05:01:36,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-15 05:01:36,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:36,224 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:36,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-15 05:01:36,225 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:36,227 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-15 05:01:36,230 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:36,231 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:36,231 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 05:01:36,231 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 05:01:36,231 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 05:01:36,231 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 05:01:36,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 05:01:36,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 05:01:36,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 05:01:36,233 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 05:01:36,233 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-15 05:01:36,233 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,233 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 05:01:36,233 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 05:01:36,233 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 05:01:36,233 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/recovered.edits] 2023-09-15 05:01:36,233 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/recovered.edits] 2023-09-15 05:01:36,233 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,233 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-15 05:01:36,238 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf/32af8c26eafb4bfa891c920a653626f7 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/cf/32af8c26eafb4bfa891c920a653626f7 2023-09-15 05:01:36,238 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf/c494ea7515e745cf9b19faf88f6f92b5 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/cf/c494ea7515e745cf9b19faf88f6f92b5 2023-09-15 05:01:36,241 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef/recovered.edits/9.seqid 2023-09-15 05:01:36,241 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc/recovered.edits/9.seqid 2023-09-15 05:01:36,242 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/ddf072ad2e5d273a58b60507463896ef 2023-09-15 05:01:36,242 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemState/3eb87072f0c75fae5fefd6d4636ca7fc 2023-09-15 05:01:36,242 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-15 05:01:36,242 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-15 05:01:36,243 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-15 05:01:36,246 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb22bdb64b8749ac8987671992913b69 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb22bdb64b8749ac8987671992913b69 2023-09-15 05:01:36,248 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309150da3c7e4277e4d728e73ade34be5ef39 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309150da3c7e4277e4d728e73ade34be5ef39 2023-09-15 05:01:36,248 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-15 05:01:36,251 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:36,253 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-15 05:01:36,257 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-15 05:01:36,258 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:36,258 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-15 05:01:36,258 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754096258"}]},"ts":"9223372036854775807"} 2023-09-15 05:01:36,258 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754096258"}]},"ts":"9223372036854775807"} 2023-09-15 05:01:36,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 05:01:36,260 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ddf072ad2e5d273a58b60507463896ef, NAME => 'testtb-testExportFileSystemState,,1694754079809.ddf072ad2e5d273a58b60507463896ef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3eb87072f0c75fae5fefd6d4636ca7fc, NAME => 'testtb-testExportFileSystemState,1,1694754079809.3eb87072f0c75fae5fefd6d4636ca7fc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 05:01:36,260 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-15 05:01:36,260 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694754096260"}]},"ts":"9223372036854775807"} 2023-09-15 05:01:36,262 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-15 05:01:36,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 05:01:36,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-09-15 05:01:36,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-15 05:01:36,335 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-15 05:01:36,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-15 05:01:36,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-15 05:01:36,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-15 05:01:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-15 05:01:36,371 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=770 (was 757) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_334865818_1 at /127.0.0.1:57482 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1373477227_17 at /127.0.0.1:56646 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_334865818_1 at /127.0.0.1:58482 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:38262 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2080 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:41333 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:39114 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=942 (was 934) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 233) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8579 (was 8736) 2023-09-15 05:01:36,371 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-09-15 05:01:36,389 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=942, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=168, AvailableMemoryMB=8578 2023-09-15 05:01:36,389 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-09-15 05:01:36,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 05:01:36,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:01:36,394 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:01:36,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-15 05:01:36,395 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:01:36,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 05:01:36,397 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,397 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,398 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047 empty. 2023-09-15 05:01:36,398 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4 empty. 2023-09-15 05:01:36,398 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,399 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,399 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-15 05:01:36,413 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-15 05:01:36,414 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ea9ee20b9b042589c5450bf0cd8f047, NAME => 'testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:01:36,414 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 39f958867df1cddb00e3992f173399a4, NAME => 'testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:01:36,430 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:36,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7ea9ee20b9b042589c5450bf0cd8f047, disabling compactions & flushes 2023-09-15 05:01:36,431 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:36,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:36,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. after waiting 0 ms 2023-09-15 05:01:36,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:36,431 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:36,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7ea9ee20b9b042589c5450bf0cd8f047: 2023-09-15 05:01:36,434 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:36,434 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 39f958867df1cddb00e3992f173399a4, disabling compactions & flushes 2023-09-15 05:01:36,435 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:36,435 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:36,435 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. after waiting 0 ms 2023-09-15 05:01:36,435 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:36,435 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:36,435 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 39f958867df1cddb00e3992f173399a4: 2023-09-15 05:01:36,437 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:01:36,438 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754096438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754096438"}]},"ts":"1694754096438"} 2023-09-15 05:01:36,438 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754096438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754096438"}]},"ts":"1694754096438"} 2023-09-15 05:01:36,440 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 05:01:36,441 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:01:36,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754096441"}]},"ts":"1694754096441"} 2023-09-15 05:01:36,443 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-15 05:01:36,448 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:01:36,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:01:36,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:01:36,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:01:36,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:01:36,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ea9ee20b9b042589c5450bf0cd8f047, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=39f958867df1cddb00e3992f173399a4, ASSIGN}] 2023-09-15 05:01:36,452 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=39f958867df1cddb00e3992f173399a4, ASSIGN 2023-09-15 05:01:36,452 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ea9ee20b9b042589c5450bf0cd8f047, ASSIGN 2023-09-15 05:01:36,453 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=39f958867df1cddb00e3992f173399a4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35769,1694754055535; forceNewPlan=false, retain=false 2023-09-15 05:01:36,453 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ea9ee20b9b042589c5450bf0cd8f047, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45061,1694754055570; forceNewPlan=false, retain=false 2023-09-15 05:01:36,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 05:01:36,604 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 05:01:36,606 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7ea9ee20b9b042589c5450bf0cd8f047, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:36,606 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=39f958867df1cddb00e3992f173399a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:36,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754096606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754096606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754096606"}]},"ts":"1694754096606"} 2023-09-15 05:01:36,607 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754096606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754096606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754096606"}]},"ts":"1694754096606"} 2023-09-15 05:01:36,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 7ea9ee20b9b042589c5450bf0cd8f047, server=jenkins-hbase4.apache.org,45061,1694754055570}] 2023-09-15 05:01:36,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 39f958867df1cddb00e3992f173399a4, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:01:36,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 05:01:36,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:36,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ea9ee20b9b042589c5450bf0cd8f047, NAME => 'testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 05:01:36,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. service=AccessControlService 2023-09-15 05:01:36,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:01:36,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:36,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39f958867df1cddb00e3992f173399a4, NAME => 'testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 05:01:36,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:36,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. service=AccessControlService 2023-09-15 05:01:36,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:01:36,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:01:36,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,766 INFO [StoreOpener-7ea9ee20b9b042589c5450bf0cd8f047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,766 INFO [StoreOpener-39f958867df1cddb00e3992f173399a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,767 DEBUG [StoreOpener-7ea9ee20b9b042589c5450bf0cd8f047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf 2023-09-15 05:01:36,767 DEBUG [StoreOpener-7ea9ee20b9b042589c5450bf0cd8f047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf 2023-09-15 05:01:36,768 DEBUG [StoreOpener-39f958867df1cddb00e3992f173399a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf 2023-09-15 05:01:36,768 DEBUG [StoreOpener-39f958867df1cddb00e3992f173399a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf 2023-09-15 05:01:36,768 INFO [StoreOpener-7ea9ee20b9b042589c5450bf0cd8f047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ea9ee20b9b042589c5450bf0cd8f047 columnFamilyName cf 2023-09-15 05:01:36,768 INFO [StoreOpener-39f958867df1cddb00e3992f173399a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39f958867df1cddb00e3992f173399a4 columnFamilyName cf 2023-09-15 05:01:36,769 INFO [StoreOpener-7ea9ee20b9b042589c5450bf0cd8f047-1] regionserver.HStore(310): Store=7ea9ee20b9b042589c5450bf0cd8f047/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:01:36,770 INFO [StoreOpener-39f958867df1cddb00e3992f173399a4-1] regionserver.HStore(310): Store=39f958867df1cddb00e3992f173399a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:01:36,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:01:36,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39f958867df1cddb00e3992f173399a4 2023-09-15 05:01:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:01:36,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ea9ee20b9b042589c5450bf0cd8f047; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65788652, jitterRate=-0.019672691822052002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:01:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ea9ee20b9b042589c5450bf0cd8f047: 2023-09-15 05:01:36,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:01:36,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047., pid=45, masterSystemTime=1694754096760 2023-09-15 05:01:36,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39f958867df1cddb00e3992f173399a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72441934, jitterRate=0.07946893572807312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:01:36,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39f958867df1cddb00e3992f173399a4: 2023-09-15 05:01:36,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4., pid=46, masterSystemTime=1694754096761 2023-09-15 05:01:36,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:36,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:36,780 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7ea9ee20b9b042589c5450bf0cd8f047, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:36,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:36,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:36,780 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754096779"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754096779"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754096779"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754096779"}]},"ts":"1694754096779"} 2023-09-15 05:01:36,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=39f958867df1cddb00e3992f173399a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:36,781 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754096780"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754096780"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754096780"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754096780"}]},"ts":"1694754096780"} 2023-09-15 05:01:36,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-15 05:01:36,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 7ea9ee20b9b042589c5450bf0cd8f047, server=jenkins-hbase4.apache.org,45061,1694754055570 in 173 msec 2023-09-15 05:01:36,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-15 05:01:36,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 39f958867df1cddb00e3992f173399a4, server=jenkins-hbase4.apache.org,35769,1694754055535 in 173 msec 2023-09-15 05:01:36,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ea9ee20b9b042589c5450bf0cd8f047, ASSIGN in 334 msec 2023-09-15 05:01:36,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-15 05:01:36,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=39f958867df1cddb00e3992f173399a4, ASSIGN in 334 msec 2023-09-15 05:01:36,787 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:01:36,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754096787"}]},"ts":"1694754096787"} 2023-09-15 05:01:36,788 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-15 05:01:36,790 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:01:36,791 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-15 05:01:36,792 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 05:01:36,794 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,794 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,794 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,794 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:01:36,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:36,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:36,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:36,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 05:01:36,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 404 msec 2023-09-15 05:01:36,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 05:01:36,999 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-15 05:01:37,001 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-15 05:01:37,001 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:37,003 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:01:37,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 05:01:37,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754097016 (current time:1694754097016). 2023-09-15 05:01:37,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:01:37,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x4d1ee10a to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:37,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66522ae5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:37,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:37,029 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:37,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d1ee10a to 127.0.0.1:60709 2023-09-15 05:01:37,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:37,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x476f425e to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:37,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d43ed08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:37,038 DEBUG [hconnection-0xab1e547-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:37,040 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:37,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:37,046 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:37,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x476f425e to 127.0.0.1:60709 2023-09-15 05:01:37,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:37,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 05:01:37,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:01:37,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 05:01:37,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 05:01:37,052 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 05:01:37,053 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694754697053 2023-09-15 05:01:37,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-15 05:01:37,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 05:01:37,054 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:01:37,055 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:01:37,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 05:01:37,056 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 05:01:37,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-15 05:01:37,058 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 05:01:37,059 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694754697059 2023-09-15 05:01:37,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,072 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-15 05:01:37,072 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,073 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-15 05:01:37,073 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-15 05:01:37,074 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,074 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,076 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,076 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,076 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,076 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,076 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,076 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,077 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,077 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 05:01:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,078 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 05:01:37,078 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,079 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 05:01:37,080 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 05:01:37,079 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 05:01:37,080 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 05:01:37,080 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,080 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,080 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 05:01:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 05:01:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 05:01:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 05:01:37,081 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 05:01:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 05:01:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 05:01:37,085 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,085 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,085 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,085 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,086 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,086 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:37,086 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,086 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:37,086 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,087 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,087 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-15 05:01:37,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@106ad6ff[Count = 1] remaining members to acquire global barrier 2023-09-15 05:01:37,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-15 05:01:37,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@106ad6ff[Count = 0] remaining members to acquire global barrier 2023-09-15 05:01:37,092 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-15 05:01:37,092 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 05:01:37,094 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,093 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 05:01:37,094 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,094 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:01:37,094 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:37,094 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:37,094 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:37,094 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. started... 2023-09-15 05:01:37,094 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. started... 2023-09-15 05:01:37,095 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ea9ee20b9b042589c5450bf0cd8f047: 2023-09-15 05:01:37,096 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 39f958867df1cddb00e3992f173399a4: 2023-09-15 05:01:37,096 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,096 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,097 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:37,097 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:37,097 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:01:37,097 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:01:37,105 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 05:01:37,105 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,105 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 05:01:37,110 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. completed. 2023-09-15 05:01:37,110 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 05:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 05:01:37,111 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 05:01:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,114 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. completed. 2023-09-15 05:01:37,114 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:37,114 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:37,114 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:37,114 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,114 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 05:01:37,114 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:01:37,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,115 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 05:01:37,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 05:01:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45061,1694754055570': 2023-09-15 05:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-15 05:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-15 05:01:37,121 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-15 05:01:37,121 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:01:37,121 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:01:37,121 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,121 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:01:37,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,124 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,124 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,125 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,126 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,127 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,127 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,131 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,131 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:01:37,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,133 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 05:01:37,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,155 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:37,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 05:01:37,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:01:37,156 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:01:37,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,169 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-15 05:01:37,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,169 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 05:01:37,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694754097053Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694754097146 (+93 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694754097146Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694754097146Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694754097150 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694754097162 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694754097169 (+7 ms) 2023-09-15 05:01:37,174 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 05:01:37,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 120 msec 2023-09-15 05:01:37,356 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:37,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 05:01:37,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:01:37,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45061] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:01:37,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35769] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:01:37,365 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-15 05:01:37,365 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:37,365 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:01:37,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 05:01:37,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754097375 (current time:1694754097375). 2023-09-15 05:01:37,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:01:37,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x52ec51df to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:37,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a2927d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:37,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:37,390 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:37,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52ec51df to 127.0.0.1:60709 2023-09-15 05:01:37,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:37,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x5de0eff6 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:01:37,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d322f3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:01:37,399 DEBUG [hconnection-0xec69af6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:37,401 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:37,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:01:37,405 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:01:37,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5de0eff6 to 127.0.0.1:60709 2023-09-15 05:01:37,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:01:37,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 05:01:37,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:01:37,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 05:01:37,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 05:01:37,410 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 05:01:37,411 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694754697411 2023-09-15 05:01:37,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 05:01:37,411 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-15 05:01:37,412 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:01:37,412 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:01:37,413 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 05:01:37,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 05:01:37,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-15 05:01:37,416 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 05:01:37,416 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694754697416 2023-09-15 05:01:37,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-15 05:01:37,428 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-15 05:01:37,428 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,429 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-15 05:01:37,429 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-15 05:01:37,430 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,430 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,431 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,431 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,431 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,432 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,432 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,432 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 05:01:37,433 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 05:01:37,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 05:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 05:01:37,433 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 05:01:37,433 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 05:01:37,433 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,433 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 05:01:37,434 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 05:01:37,435 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 05:01:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,435 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 05:01:37,436 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 05:01:37,435 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 05:01:37,436 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 05:01:37,436 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 05:01:37,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 05:01:37,436 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 05:01:37,436 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:01:37,437 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 05:01:37,437 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 05:01:37,437 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 05:01:37,438 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,439 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,439 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,439 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:37,439 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,440 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,440 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:01:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-15 05:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25961752[Count = 1] remaining members to acquire global barrier 2023-09-15 05:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-15 05:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25961752[Count = 0] remaining members to acquire global barrier 2023-09-15 05:01:37,445 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-15 05:01:37,445 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,447 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 05:01:37,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 05:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,447 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:01:37,447 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 05:01:37,447 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 05:01:37,447 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,447 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:01:37,447 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:37,448 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:37,448 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:01:37,448 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:01:37,448 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:37,448 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:37,448 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. started... 2023-09-15 05:01:37,448 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. started... 2023-09-15 05:01:37,448 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ea9ee20b9b042589c5450bf0cd8f047 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-15 05:01:37,448 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 39f958867df1cddb00e3992f173399a4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-15 05:01:37,449 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 05:01:37,449 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,449 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 05:01:37,477 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915160d41e2dfe64af59e8d905a93743e03 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915160d41e2dfe64af59e8d905a93743e03 2023-09-15 05:01:37,479 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091561f8e866063340089ccc05e8f68a5439 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091561f8e866063340089ccc05e8f68a5439 2023-09-15 05:01:37,487 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/.tmp/cf/86f7881501c244009788329575418dbc 2023-09-15 05:01:37,490 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/.tmp/cf/e41ea6a565c94d1983134d1b8e5b4381 2023-09-15 05:01:37,499 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/.tmp/cf/86f7881501c244009788329575418dbc as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf/86f7881501c244009788329575418dbc 2023-09-15 05:01:37,500 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/.tmp/cf/e41ea6a565c94d1983134d1b8e5b4381 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf/e41ea6a565c94d1983134d1b8e5b4381 2023-09-15 05:01:37,504 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf/86f7881501c244009788329575418dbc, entries=4, sequenceid=6, filesize=5.6 K 2023-09-15 05:01:37,505 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf/e41ea6a565c94d1983134d1b8e5b4381, entries=46, sequenceid=6, filesize=12.5 K 2023-09-15 05:01:37,505 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 7ea9ee20b9b042589c5450bf0cd8f047 in 57ms, sequenceid=6, compaction requested=false 2023-09-15 05:01:37,505 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-15 05:01:37,506 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ea9ee20b9b042589c5450bf0cd8f047: 2023-09-15 05:01:37,506 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 39f958867df1cddb00e3992f173399a4 in 58ms, sequenceid=6, compaction requested=false 2023-09-15 05:01:37,506 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 39f958867df1cddb00e3992f173399a4: 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf/86f7881501c244009788329575418dbc] hfiles 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf/86f7881501c244009788329575418dbc for snapshot=snaptb0-testConsecutiveExports 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf/e41ea6a565c94d1983134d1b8e5b4381] hfiles 2023-09-15 05:01:37,508 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf/e41ea6a565c94d1983134d1b8e5b4381 for snapshot=snaptb0-testConsecutiveExports 2023-09-15 05:01:37,512 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:37,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 05:01:37,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:01:37,514 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:01:37,523 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. completed. 2023-09-15 05:01:37,523 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:01:37,523 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:01:37,524 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. completed. 2023-09-15 05:01:37,524 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 05:01:37,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:01:37,525 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 05:01:37,525 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,525 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,525 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 05:01:37,528 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 05:01:37,528 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,528 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,528 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 05:01:37,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45061,1694754055570': 2023-09-15 05:01:37,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-15 05:01:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:01:37,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-15 05:01:37,535 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-15 05:01:37,535 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:01:37,535 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:01:37,535 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-15 05:01:37,535 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:01:37,537 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:01:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:01:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,538 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:01:37,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,538 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:01:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,540 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,540 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:01:37,541 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 05:01:37,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,546 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,546 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,546 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,546 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,547 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,546 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:01:37,547 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:01:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:01:37,547 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,547 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,547 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,547 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:01:37,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:01:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:01:37,553 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:01:37,553 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,553 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:01:37,553 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:01:37,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-15 05:01:37,553 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:01:37,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-15 05:01:37,555 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,555 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 05:01:37,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:01:37,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091561f8e866063340089ccc05e8f68a5439, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915160d41e2dfe64af59e8d905a93743e03] mob files 2023-09-15 05:01:37,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091561f8e866063340089ccc05e8f68a5439 2023-09-15 05:01:37,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915160d41e2dfe64af59e8d905a93743e03 2023-09-15 05:01:37,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-15 05:01:37,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-15 05:01:37,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,589 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694754097411Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694754097567 (+156 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694754097567Loading Region manifests for snaptb0-testConsecutiveExports at 1694754097567Writing data manifest for snaptb0-testConsecutiveExports at 1694754097571 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694754097581 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694754097589 (+8 ms) 2023-09-15 05:01:37,592 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 05:01:37,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 180 msec 2023-09-15 05:01:37,714 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:01:37,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 05:01:37,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:01:37,715 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715 2023-09-15 05:01:37,715 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715, srcFsUri=hdfs://localhost:41743, srcDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:37,738 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:37,738 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2182bec0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,738 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, snapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-15 05:01:37,747 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 05:01:37,759 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:37,759 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:37,760 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:37,760 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,640 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-366406939035416427.jar 2023-09-15 05:01:38,640 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,640 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,707 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-8822014430044411630.jar 2023-09-15 05:01:38,707 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,708 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,708 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,708 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,709 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,709 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:38,709 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 05:01:38,710 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 05:01:38,710 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 05:01:38,710 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 05:01:38,711 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 05:01:38,711 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 05:01:38,712 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 05:01:38,712 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 05:01:38,712 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 05:01:38,713 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 05:01:38,713 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:38,714 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:38,714 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:38,715 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:38,715 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:38,715 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:38,716 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:39,065 WARN [Listener at jenkins-hbase4.apache.org/33501] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 05:01:39,068 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-15 05:01:39,070 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-15 05:01:40,649 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:40,650 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:40,652 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0002_000001 (auth:SIMPLE) 2023-09-15 05:01:41,454 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0003_000001 (auth:SIMPLE) 2023-09-15 05:01:41,677 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:01:45,178 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0003_000001 (auth:SIMPLE) 2023-09-15 05:01:47,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0003_000001 (auth:SIMPLE) 2023-09-15 05:01:49,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0003_000001 (auth:SIMPLE) 2023-09-15 05:01:51,233 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 05:01:51,234 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 05:01:51,238 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-15 05:01:51,238 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 05:01:51,239 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 05:01:51,239 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 05:01:51,241 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 05:01:51,241 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 05:01:51,241 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4aa6d09d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 05:01:51,242 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 05:01:51,242 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 05:01:51,243 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715, srcFsUri=hdfs://localhost:41743, srcDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:51,264 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:01:51,265 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5a84f96e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 05:01:51,265 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, snapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-15 05:01:51,275 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 05:01:51,286 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:51,287 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:51,287 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:51,287 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,157 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-1636061014950535882.jar 2023-09-15 05:01:52,158 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,158 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,224 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-3460655761742817732.jar 2023-09-15 05:01:52,224 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,224 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,225 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,225 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,226 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,226 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 05:01:52,226 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 05:01:52,227 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 05:01:52,227 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 05:01:52,228 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 05:01:52,228 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 05:01:52,229 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 05:01:52,229 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 05:01:52,229 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 05:01:52,229 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 05:01:52,230 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 05:01:52,231 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:52,231 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:52,232 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:52,232 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:52,233 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:01:52,234 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:52,234 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:01:52,577 WARN [Listener at jenkins-hbase4.apache.org/33501] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 05:01:52,579 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-15 05:01:52,581 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-15 05:01:55,855 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:55,855 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:01:55,858 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0003_000001 (auth:SIMPLE) 2023-09-15 05:01:56,661 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0004_000001 (auth:SIMPLE) 2023-09-15 05:02:00,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0004_000001 (auth:SIMPLE) 2023-09-15 05:02:02,549 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0004_000001 (auth:SIMPLE) 2023-09-15 05:02:04,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0004_000001 (auth:SIMPLE) 2023-09-15 05:02:06,732 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 05:02:06,732 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 05:02:06,735 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-15 05:02:06,735 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 05:02:06,735 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 05:02:06,736 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 05:02:06,739 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 05:02:06,739 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 05:02:06,739 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4aa6d09d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 05:02:06,740 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 05:02:06,740 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/local-export-1694754097715/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 05:02:06,752 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-15 05:02:06,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-15 05:02:06,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:02:06,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 05:02:06,756 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754126756"}]},"ts":"1694754126756"} 2023-09-15 05:02:06,758 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-15 05:02:06,759 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-15 05:02:06,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ea9ee20b9b042589c5450bf0cd8f047, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=39f958867df1cddb00e3992f173399a4, UNASSIGN}] 2023-09-15 05:02:06,762 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ea9ee20b9b042589c5450bf0cd8f047, UNASSIGN 2023-09-15 05:02:06,762 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=39f958867df1cddb00e3992f173399a4, UNASSIGN 2023-09-15 05:02:06,762 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7ea9ee20b9b042589c5450bf0cd8f047, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:06,762 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=39f958867df1cddb00e3992f173399a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:06,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754126762"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754126762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754126762"}]},"ts":"1694754126762"} 2023-09-15 05:02:06,763 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754126762"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754126762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754126762"}]},"ts":"1694754126762"} 2023-09-15 05:02:06,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 7ea9ee20b9b042589c5450bf0cd8f047, server=jenkins-hbase4.apache.org,45061,1694754055570}] 2023-09-15 05:02:06,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 39f958867df1cddb00e3992f173399a4, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:06,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 05:02:06,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:02:06,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ea9ee20b9b042589c5450bf0cd8f047, disabling compactions & flushes 2023-09-15 05:02:06,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:02:06,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:02:06,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. after waiting 0 ms 2023-09-15 05:02:06,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:02:06,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 39f958867df1cddb00e3992f173399a4 2023-09-15 05:02:06,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39f958867df1cddb00e3992f173399a4, disabling compactions & flushes 2023-09-15 05:02:06,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:02:06,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:02:06,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. after waiting 0 ms 2023-09-15 05:02:06,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:02:06,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:06,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:06,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:06,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:06,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047. 2023-09-15 05:02:06,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4. 2023-09-15 05:02:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ea9ee20b9b042589c5450bf0cd8f047: 2023-09-15 05:02:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39f958867df1cddb00e3992f173399a4: 2023-09-15 05:02:06,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 39f958867df1cddb00e3992f173399a4 2023-09-15 05:02:06,933 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=39f958867df1cddb00e3992f173399a4, regionState=CLOSED 2023-09-15 05:02:06,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:02:06,933 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754126933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754126933"}]},"ts":"1694754126933"} 2023-09-15 05:02:06,934 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7ea9ee20b9b042589c5450bf0cd8f047, regionState=CLOSED 2023-09-15 05:02:06,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694754126934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754126934"}]},"ts":"1694754126934"} 2023-09-15 05:02:06,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-15 05:02:06,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 39f958867df1cddb00e3992f173399a4, server=jenkins-hbase4.apache.org,35769,1694754055535 in 170 msec 2023-09-15 05:02:06,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-15 05:02:06,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 7ea9ee20b9b042589c5450bf0cd8f047, server=jenkins-hbase4.apache.org,45061,1694754055570 in 171 msec 2023-09-15 05:02:06,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=39f958867df1cddb00e3992f173399a4, UNASSIGN in 176 msec 2023-09-15 05:02:06,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-15 05:02:06,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ea9ee20b9b042589c5450bf0cd8f047, UNASSIGN in 177 msec 2023-09-15 05:02:06,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754126939"}]},"ts":"1694754126939"} 2023-09-15 05:02:06,940 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-15 05:02:06,942 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-15 05:02:06,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 191 msec 2023-09-15 05:02:07,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 05:02:07,058 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-15 05:02:07,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-15 05:02:07,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:02:07,062 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:02:07,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-15 05:02:07,063 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:02:07,066 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-15 05:02:07,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:02:07,069 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,069 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,069 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,069 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4 2023-09-15 05:02:07,069 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 05:02:07,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 05:02:07,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 05:02:07,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 05:02:07,072 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,072 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/recovered.edits] 2023-09-15 05:02:07,073 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/recovered.edits] 2023-09-15 05:02:07,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-15 05:02:07,076 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf/e41ea6a565c94d1983134d1b8e5b4381 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/cf/e41ea6a565c94d1983134d1b8e5b4381 2023-09-15 05:02:07,077 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf/86f7881501c244009788329575418dbc to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/cf/86f7881501c244009788329575418dbc 2023-09-15 05:02:07,080 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4/recovered.edits/9.seqid 2023-09-15 05:02:07,080 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047/recovered.edits/9.seqid 2023-09-15 05:02:07,081 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/39f958867df1cddb00e3992f173399a4 2023-09-15 05:02:07,081 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testConsecutiveExports/7ea9ee20b9b042589c5450bf0cd8f047 2023-09-15 05:02:07,081 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-15 05:02:07,081 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-15 05:02:07,082 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-15 05:02:07,085 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091561f8e866063340089ccc05e8f68a5439 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091561f8e866063340089ccc05e8f68a5439 2023-09-15 05:02:07,087 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915160d41e2dfe64af59e8d905a93743e03 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915160d41e2dfe64af59e8d905a93743e03 2023-09-15 05:02:07,088 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-15 05:02:07,090 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:02:07,093 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-15 05:02:07,095 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-15 05:02:07,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:02:07,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-15 05:02:07,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754127097"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:07,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754127097"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:07,099 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 05:02:07,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ea9ee20b9b042589c5450bf0cd8f047, NAME => 'testtb-testConsecutiveExports,,1694754096390.7ea9ee20b9b042589c5450bf0cd8f047.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 39f958867df1cddb00e3992f173399a4, NAME => 'testtb-testConsecutiveExports,1,1694754096390.39f958867df1cddb00e3992f173399a4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 05:02:07,099 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-15 05:02:07,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694754127099"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:07,100 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-15 05:02:07,103 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 05:02:07,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-09-15 05:02:07,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-15 05:02:07,174 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-15 05:02:07,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-15 05:02:07,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-15 05:02:07,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-15 05:02:07,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-15 05:02:07,209 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 770), OpenFileDescriptor=901 (was 942), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 247) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8345 (was 8578) 2023-09-15 05:02:07,209 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-15 05:02:07,227 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=168, AvailableMemoryMB=8345 2023-09-15 05:02:07,227 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-15 05:02:07,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 05:02:07,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,231 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:02:07,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-15 05:02:07,232 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:02:07,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 05:02:07,235 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,235 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,235 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe empty. 2023-09-15 05:02:07,235 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789 empty. 2023-09-15 05:02:07,235 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,236 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,236 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-15 05:02:07,244 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-15 05:02:07,246 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f436aea906fc25b0a281f81e370abffe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:07,246 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2d5418e5d18979349fc7e307e6b8f789, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:07,253 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:07,253 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 2d5418e5d18979349fc7e307e6b8f789, disabling compactions & flushes 2023-09-15 05:02:07,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,253 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,253 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. after waiting 0 ms 2023-09-15 05:02:07,253 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,253 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 2d5418e5d18979349fc7e307e6b8f789: 2023-09-15 05:02:07,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:07,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f436aea906fc25b0a281f81e370abffe, disabling compactions & flushes 2023-09-15 05:02:07,256 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. after waiting 0 ms 2023-09-15 05:02:07,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,256 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f436aea906fc25b0a281f81e370abffe: 2023-09-15 05:02:07,258 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:02:07,259 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754127259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754127259"}]},"ts":"1694754127259"} 2023-09-15 05:02:07,259 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754127259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754127259"}]},"ts":"1694754127259"} 2023-09-15 05:02:07,265 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 05:02:07,266 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:02:07,266 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754127266"}]},"ts":"1694754127266"} 2023-09-15 05:02:07,268 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-15 05:02:07,276 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:02:07,277 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:02:07,277 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:02:07,277 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:02:07,277 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:02:07,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f436aea906fc25b0a281f81e370abffe, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d5418e5d18979349fc7e307e6b8f789, ASSIGN}] 2023-09-15 05:02:07,280 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d5418e5d18979349fc7e307e6b8f789, ASSIGN 2023-09-15 05:02:07,280 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f436aea906fc25b0a281f81e370abffe, ASSIGN 2023-09-15 05:02:07,281 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d5418e5d18979349fc7e307e6b8f789, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35769,1694754055535; forceNewPlan=false, retain=false 2023-09-15 05:02:07,281 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f436aea906fc25b0a281f81e370abffe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36615,1694754055486; forceNewPlan=false, retain=false 2023-09-15 05:02:07,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 05:02:07,431 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 05:02:07,433 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2d5418e5d18979349fc7e307e6b8f789, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,433 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f436aea906fc25b0a281f81e370abffe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,433 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754127433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754127433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754127433"}]},"ts":"1694754127433"} 2023-09-15 05:02:07,434 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754127433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754127433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754127433"}]},"ts":"1694754127433"} 2023-09-15 05:02:07,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 2d5418e5d18979349fc7e307e6b8f789, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:07,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure f436aea906fc25b0a281f81e370abffe, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:07,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 05:02:07,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d5418e5d18979349fc7e307e6b8f789, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 05:02:07,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f436aea906fc25b0a281f81e370abffe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 05:02:07,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. service=AccessControlService 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. service=AccessControlService 2023-09-15 05:02:07,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:07,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,597 INFO [StoreOpener-2d5418e5d18979349fc7e307e6b8f789-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,597 INFO [StoreOpener-f436aea906fc25b0a281f81e370abffe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,600 DEBUG [StoreOpener-2d5418e5d18979349fc7e307e6b8f789-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf 2023-09-15 05:02:07,600 DEBUG [StoreOpener-f436aea906fc25b0a281f81e370abffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf 2023-09-15 05:02:07,600 DEBUG [StoreOpener-2d5418e5d18979349fc7e307e6b8f789-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf 2023-09-15 05:02:07,600 DEBUG [StoreOpener-f436aea906fc25b0a281f81e370abffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf 2023-09-15 05:02:07,601 INFO [StoreOpener-f436aea906fc25b0a281f81e370abffe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f436aea906fc25b0a281f81e370abffe columnFamilyName cf 2023-09-15 05:02:07,601 INFO [StoreOpener-2d5418e5d18979349fc7e307e6b8f789-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d5418e5d18979349fc7e307e6b8f789 columnFamilyName cf 2023-09-15 05:02:07,603 INFO [StoreOpener-2d5418e5d18979349fc7e307e6b8f789-1] regionserver.HStore(310): Store=2d5418e5d18979349fc7e307e6b8f789/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:07,603 INFO [StoreOpener-f436aea906fc25b0a281f81e370abffe-1] regionserver.HStore(310): Store=f436aea906fc25b0a281f81e370abffe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:07,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:07,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:07,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:07,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:07,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d5418e5d18979349fc7e307e6b8f789; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67788691, jitterRate=0.01013021171092987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:07,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d5418e5d18979349fc7e307e6b8f789: 2023-09-15 05:02:07,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f436aea906fc25b0a281f81e370abffe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72685973, jitterRate=0.08310540020465851}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:07,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f436aea906fc25b0a281f81e370abffe: 2023-09-15 05:02:07,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789., pid=60, masterSystemTime=1694754127587 2023-09-15 05:02:07,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe., pid=61, masterSystemTime=1694754127587 2023-09-15 05:02:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,617 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2d5418e5d18979349fc7e307e6b8f789, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,617 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754127617"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754127617"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754127617"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754127617"}]},"ts":"1694754127617"} 2023-09-15 05:02:07,618 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f436aea906fc25b0a281f81e370abffe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,618 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754127618"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754127618"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754127618"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754127618"}]},"ts":"1694754127618"} 2023-09-15 05:02:07,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-15 05:02:07,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 2d5418e5d18979349fc7e307e6b8f789, server=jenkins-hbase4.apache.org,35769,1694754055535 in 184 msec 2023-09-15 05:02:07,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-15 05:02:07,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d5418e5d18979349fc7e307e6b8f789, ASSIGN in 344 msec 2023-09-15 05:02:07,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure f436aea906fc25b0a281f81e370abffe, server=jenkins-hbase4.apache.org,36615,1694754055486 in 184 msec 2023-09-15 05:02:07,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-15 05:02:07,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f436aea906fc25b0a281f81e370abffe, ASSIGN in 345 msec 2023-09-15 05:02:07,625 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:02:07,625 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754127625"}]},"ts":"1694754127625"} 2023-09-15 05:02:07,626 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-15 05:02:07,628 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:02:07,628 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-15 05:02:07,630 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 05:02:07,631 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,631 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,631 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,631 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:07,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:07,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:07,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:07,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:07,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 404 msec 2023-09-15 05:02:07,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 05:02:07,836 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-15 05:02:07,838 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,839 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,840 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:02:07,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 05:02:07,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754127852 (current time:1694754127852). 2023-09-15 05:02:07,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:02:07,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x7a89b332 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:07,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79399ac8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:07,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:07,863 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:07,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a89b332 to 127.0.0.1:60709 2023-09-15 05:02:07,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:07,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x11099b56 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:07,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@262eaa66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:07,871 DEBUG [hconnection-0x13749bb1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:07,872 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:07,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:07,878 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:07,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11099b56 to 127.0.0.1:60709 2023-09-15 05:02:07,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:07,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 05:02:07,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:02:07,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 05:02:07,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 05:02:07,883 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 05:02:07,883 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694754727883 2023-09-15 05:02:07,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 05:02:07,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,885 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:02:07,885 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:02:07,886 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 05:02:07,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 05:02:07,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-15 05:02:07,888 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 05:02:07,888 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694754727888 2023-09-15 05:02:07,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,897 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-15 05:02:07,897 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:07,898 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-15 05:02:07,898 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-15 05:02:07,898 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,898 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,900 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:07,900 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:07,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:07,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:07,900 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,900 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:07,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,901 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,901 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,902 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 05:02:07,902 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,902 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 05:02:07,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,902 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 05:02:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:07,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,904 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 05:02:07,904 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 05:02:07,904 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 05:02:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 05:02:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 05:02:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 05:02:07,904 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 05:02:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 05:02:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 05:02:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 05:02:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,907 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,908 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:07,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:07,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 05:02:07,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bcfcc9a[Count = 1] remaining members to acquire global barrier 2023-09-15 05:02:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:07,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 05:02:07,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bcfcc9a[Count = 0] remaining members to acquire global barrier 2023-09-15 05:02:07,912 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-15 05:02:07,912 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,913 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 05:02:07,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,913 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:07,914 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,914 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,914 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:02:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 05:02:07,914 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. started... 2023-09-15 05:02:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d5418e5d18979349fc7e307e6b8f789: 2023-09-15 05:02:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. started... 2023-09-15 05:02:07,915 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 05:02:07,915 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f436aea906fc25b0a281f81e370abffe: 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:07,915 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:02:07,920 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 05:02:07,920 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:07,920 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 05:02:07,925 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. completed. 2023-09-15 05:02:07,925 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:07,925 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. completed. 2023-09-15 05:02:07,925 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:02:07,925 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 05:02:07,926 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:02:07,927 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 05:02:07,927 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:07,927 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 05:02:07,927 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,928 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:07,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:07,927 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 05:02:07,928 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 05:02:07,928 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:07,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:07,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:02:07,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-15 05:02:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:07,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:07,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:02:07,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-15 05:02:07,935 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-15 05:02:07,935 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:02:07,935 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:02:07,935 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,935 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:02:07,937 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:07,937 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,937 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:07,938 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:07,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:07,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:07,938 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,938 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:07,940 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,941 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,941 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:07,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:07,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:07,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:07,945 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:07,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:07,944 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:07,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,945 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:07,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:02:07,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 05:02:07,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-15 05:02:07,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,980 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694754127883Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694754127959 (+76 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694754127959Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694754127959Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694754127963 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694754127973 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694754127979 (+6 ms) 2023-09-15 05:02:07,982 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 05:02:07,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 98 msec 2023-09-15 05:02:07,985 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:07,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 05:02:07,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:02:07,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:02:07,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35769] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:02:07,992 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:07,992 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:07,992 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:02:08,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 05:02:08,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754128002 (current time:1694754128002). 2023-09-15 05:02:08,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:02:08,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x75300431 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:08,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c108163, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:08,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:08,014 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:08,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75300431 to 127.0.0.1:60709 2023-09-15 05:02:08,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:08,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x68b4864b to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:08,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dd016e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:08,023 DEBUG [hconnection-0x550397a0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:08,025 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:08,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:08,030 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:08,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68b4864b to 127.0.0.1:60709 2023-09-15 05:02:08,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:08,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 05:02:08,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:02:08,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 05:02:08,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 05:02:08,035 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 05:02:08,035 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694754728035 2023-09-15 05:02:08,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 05:02:08,037 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:02:08,037 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:02:08,038 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 05:02:08,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 05:02:08,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-15 05:02:08,039 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 05:02:08,040 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694754728040 2023-09-15 05:02:08,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,048 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-15 05:02:08,048 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:08,049 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-15 05:02:08,049 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-15 05:02:08,049 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,049 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,052 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:08,052 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:08,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:08,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:08,052 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,052 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:08,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:08,052 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,052 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,053 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,053 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 05:02:08,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,054 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 05:02:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 05:02:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 05:02:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 05:02:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 05:02:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 05:02:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 05:02:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 05:02:08,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 05:02:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 05:02:08,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,057 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 05:02:08,057 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:08,057 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 05:02:08,057 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 05:02:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 05:02:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,058 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:08,059 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,059 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:08,059 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,059 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:08,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62886eed[Count = 1] remaining members to acquire global barrier 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:08,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 05:02:08,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62886eed[Count = 0] remaining members to acquire global barrier 2023-09-15 05:02:08,063 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-15 05:02:08,063 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,064 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 05:02:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 05:02:08,065 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:08,065 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,065 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:08,065 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:08,065 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. started... 2023-09-15 05:02:08,065 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. started... 2023-09-15 05:02:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:08,065 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f436aea906fc25b0a281f81e370abffe 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-15 05:02:08,066 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d5418e5d18979349fc7e307e6b8f789 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-15 05:02:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 05:02:08,068 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:08,068 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 05:02:08,085 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091589ab1ba7e3e1437898e4e9ddfb5ac437 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091589ab1ba7e3e1437898e4e9ddfb5ac437 2023-09-15 05:02:08,086 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309152689e0302dcf4f52b3db7a181d379ad2 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309152689e0302dcf4f52b3db7a181d379ad2 2023-09-15 05:02:08,094 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/.tmp/cf/cd3cdc96608c4fc182ded62a5bd76c52 2023-09-15 05:02:08,095 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/.tmp/cf/970b8501e590486f9ebf8f1b42f951f3 2023-09-15 05:02:08,099 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/.tmp/cf/cd3cdc96608c4fc182ded62a5bd76c52 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf/cd3cdc96608c4fc182ded62a5bd76c52 2023-09-15 05:02:08,099 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/.tmp/cf/970b8501e590486f9ebf8f1b42f951f3 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf/970b8501e590486f9ebf8f1b42f951f3 2023-09-15 05:02:08,104 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf/cd3cdc96608c4fc182ded62a5bd76c52, entries=3, sequenceid=6, filesize=5.4 K 2023-09-15 05:02:08,104 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf/970b8501e590486f9ebf8f1b42f951f3, entries=47, sequenceid=6, filesize=13.5 K 2023-09-15 05:02:08,105 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 2d5418e5d18979349fc7e307e6b8f789 in 39ms, sequenceid=6, compaction requested=false 2023-09-15 05:02:08,106 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-15 05:02:08,106 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d5418e5d18979349fc7e307e6b8f789: 2023-09-15 05:02:08,106 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,106 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:08,107 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf/970b8501e590486f9ebf8f1b42f951f3] hfiles 2023-09-15 05:02:08,107 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf/970b8501e590486f9ebf8f1b42f951f3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,109 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f436aea906fc25b0a281f81e370abffe in 44ms, sequenceid=6, compaction requested=false 2023-09-15 05:02:08,111 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f436aea906fc25b0a281f81e370abffe: 2023-09-15 05:02:08,111 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,111 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:08,111 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf/cd3cdc96608c4fc182ded62a5bd76c52] hfiles 2023-09-15 05:02:08,111 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf/cd3cdc96608c4fc182ded62a5bd76c52 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,115 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. completed. 2023-09-15 05:02:08,115 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:08,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:08,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:08,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 05:02:08,115 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:02:08,117 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,117 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 05:02:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:08,117 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:08,117 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 05:02:08,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:08,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:08,119 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. completed. 2023-09-15 05:02:08,119 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:08,119 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:08,119 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:08,120 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,120 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 05:02:08,120 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:02:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,121 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,121 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 05:02:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,121 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:08,121 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 05:02:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:02:08,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-15 05:02:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:08,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:08,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:02:08,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-15 05:02:08,127 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-15 05:02:08,127 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:02:08,127 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:02:08,127 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,127 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:02:08,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:08,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:08,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:08,134 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:08,134 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:08,135 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,135 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,137 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,137 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,137 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:08,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:08,137 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 05:02:08,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:02:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,138 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:02:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:08,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:08,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,140 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:08,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:08,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:08,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,140 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:08,142 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,142 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:02:08,142 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:08,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:08,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:08,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:08,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:08,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:08,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:08,142 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,143 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309152689e0302dcf4f52b3db7a181d379ad2, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091589ab1ba7e3e1437898e4e9ddfb5ac437] mob files 2023-09-15 05:02:08,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309152689e0302dcf4f52b3db7a181d379ad2 2023-09-15 05:02:08,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091589ab1ba7e3e1437898e4e9ddfb5ac437 2023-09-15 05:02:08,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-15 05:02:08,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,169 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694754128036Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694754128150 (+114 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694754128150Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694754128150Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694754128153 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694754128160 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694754128168 (+8 ms) 2023-09-15 05:02:08,171 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 05:02:08,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 135 msec 2023-09-15 05:02:08,338 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:08,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 05:02:08,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:02:08,367 DEBUG [Listener at jenkins-hbase4.apache.org/33501] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 05:02:08,371 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 05:02:08,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35769] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 05:02:08,373 DEBUG [Listener at jenkins-hbase4.apache.org/33501] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 05:02:08,375 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 05:02:08,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36615] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 05:02:08,376 DEBUG [Listener at jenkins-hbase4.apache.org/33501] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 05:02:08,380 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 05:02:08,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45061] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 05:02:08,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-15 05:02:08,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:08,384 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:02:08,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-15 05:02:08,385 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:02:08,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 05:02:08,387 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,387 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,388 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c empty. 2023-09-15 05:02:08,388 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53 empty. 2023-09-15 05:02:08,388 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,388 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,388 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-15 05:02:08,400 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-15 05:02:08,401 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a380112585ed77e225cde8778ad7d35c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:08,402 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => fd943003763ef27ae50a9ccc96533d53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing fd943003763ef27ae50a9ccc96533d53, disabling compactions & flushes 2023-09-15 05:02:08,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. after waiting 0 ms 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a380112585ed77e225cde8778ad7d35c, disabling compactions & flushes 2023-09-15 05:02:08,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:08,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for fd943003763ef27ae50a9ccc96533d53: 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. after waiting 0 ms 2023-09-15 05:02:08,409 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:08,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:08,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a380112585ed77e225cde8778ad7d35c: 2023-09-15 05:02:08,412 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:02:08,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754128412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754128412"}]},"ts":"1694754128412"} 2023-09-15 05:02:08,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754128412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754128412"}]},"ts":"1694754128412"} 2023-09-15 05:02:08,414 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 05:02:08,415 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:02:08,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754128415"}]},"ts":"1694754128415"} 2023-09-15 05:02:08,416 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-15 05:02:08,419 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:02:08,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:02:08,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:02:08,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:02:08,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:02:08,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a380112585ed77e225cde8778ad7d35c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd943003763ef27ae50a9ccc96533d53, ASSIGN}] 2023-09-15 05:02:08,423 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd943003763ef27ae50a9ccc96533d53, ASSIGN 2023-09-15 05:02:08,423 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a380112585ed77e225cde8778ad7d35c, ASSIGN 2023-09-15 05:02:08,424 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd943003763ef27ae50a9ccc96533d53, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35769,1694754055535; forceNewPlan=false, retain=false 2023-09-15 05:02:08,424 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a380112585ed77e225cde8778ad7d35c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36615,1694754055486; forceNewPlan=false, retain=false 2023-09-15 05:02:08,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 05:02:08,574 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 05:02:08,577 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a380112585ed77e225cde8778ad7d35c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fd943003763ef27ae50a9ccc96533d53, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,577 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754128577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754128577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754128577"}]},"ts":"1694754128577"} 2023-09-15 05:02:08,577 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754128577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754128577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754128577"}]},"ts":"1694754128577"} 2023-09-15 05:02:08,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure a380112585ed77e225cde8778ad7d35c, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:08,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure fd943003763ef27ae50a9ccc96533d53, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:08,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 05:02:08,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:08,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a380112585ed77e225cde8778ad7d35c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.', STARTKEY => '', ENDKEY => '2'} 2023-09-15 05:02:08,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:08,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd943003763ef27ae50a9ccc96533d53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.', STARTKEY => '2', ENDKEY => ''} 2023-09-15 05:02:08,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. service=AccessControlService 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. service=AccessControlService 2023-09-15 05:02:08,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:08,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,736 INFO [StoreOpener-a380112585ed77e225cde8778ad7d35c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,736 INFO [StoreOpener-fd943003763ef27ae50a9ccc96533d53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,737 DEBUG [StoreOpener-a380112585ed77e225cde8778ad7d35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf 2023-09-15 05:02:08,737 DEBUG [StoreOpener-a380112585ed77e225cde8778ad7d35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf 2023-09-15 05:02:08,738 DEBUG [StoreOpener-fd943003763ef27ae50a9ccc96533d53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf 2023-09-15 05:02:08,738 DEBUG [StoreOpener-fd943003763ef27ae50a9ccc96533d53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf 2023-09-15 05:02:08,738 INFO [StoreOpener-fd943003763ef27ae50a9ccc96533d53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd943003763ef27ae50a9ccc96533d53 columnFamilyName cf 2023-09-15 05:02:08,738 INFO [StoreOpener-a380112585ed77e225cde8778ad7d35c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a380112585ed77e225cde8778ad7d35c columnFamilyName cf 2023-09-15 05:02:08,739 INFO [StoreOpener-fd943003763ef27ae50a9ccc96533d53-1] regionserver.HStore(310): Store=fd943003763ef27ae50a9ccc96533d53/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:08,739 INFO [StoreOpener-a380112585ed77e225cde8778ad7d35c-1] regionserver.HStore(310): Store=a380112585ed77e225cde8778ad7d35c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:08,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:08,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:08,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:08,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:08,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a380112585ed77e225cde8778ad7d35c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71904399, jitterRate=0.07145904004573822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:08,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd943003763ef27ae50a9ccc96533d53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69747117, jitterRate=0.03931303322315216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:08,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a380112585ed77e225cde8778ad7d35c: 2023-09-15 05:02:08,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd943003763ef27ae50a9ccc96533d53: 2023-09-15 05:02:08,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53., pid=70, masterSystemTime=1694754128732 2023-09-15 05:02:08,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c., pid=69, masterSystemTime=1694754128730 2023-09-15 05:02:08,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:08,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:08,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fd943003763ef27ae50a9ccc96533d53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:08,748 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754128748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754128748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754128748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754128748"}]},"ts":"1694754128748"} 2023-09-15 05:02:08,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:08,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:08,748 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a380112585ed77e225cde8778ad7d35c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:08,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754128748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754128748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754128748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754128748"}]},"ts":"1694754128748"} 2023-09-15 05:02:08,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-15 05:02:08,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure fd943003763ef27ae50a9ccc96533d53, server=jenkins-hbase4.apache.org,35769,1694754055535 in 170 msec 2023-09-15 05:02:08,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-15 05:02:08,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure a380112585ed77e225cde8778ad7d35c, server=jenkins-hbase4.apache.org,36615,1694754055486 in 171 msec 2023-09-15 05:02:08,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd943003763ef27ae50a9ccc96533d53, ASSIGN in 331 msec 2023-09-15 05:02:08,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-15 05:02:08,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a380112585ed77e225cde8778ad7d35c, ASSIGN in 332 msec 2023-09-15 05:02:08,755 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:02:08,755 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754128755"}]},"ts":"1694754128755"} 2023-09-15 05:02:08,756 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-15 05:02:08,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:02:08,760 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-15 05:02:08,762 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-15 05:02:08,763 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:08,763 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:08,763 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:08,763 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:08,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:08,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 382 msec 2023-09-15 05:02:08,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 05:02:08,989 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-15 05:02:09,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a380112585ed77e225cde8778ad7d35c, fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:09,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a380112585ed77e225cde8778ad7d35c, fd943003763ef27ae50a9ccc96533d53], force=true 2023-09-15 05:02:09,020 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a380112585ed77e225cde8778ad7d35c, fd943003763ef27ae50a9ccc96533d53], force=true 2023-09-15 05:02:09,020 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a380112585ed77e225cde8778ad7d35c, fd943003763ef27ae50a9ccc96533d53], force=true 2023-09-15 05:02:09,020 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a380112585ed77e225cde8778ad7d35c, fd943003763ef27ae50a9ccc96533d53], force=true 2023-09-15 05:02:09,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 05:02:09,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a380112585ed77e225cde8778ad7d35c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd943003763ef27ae50a9ccc96533d53, UNASSIGN}] 2023-09-15 05:02:09,042 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a380112585ed77e225cde8778ad7d35c, UNASSIGN 2023-09-15 05:02:09,042 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd943003763ef27ae50a9ccc96533d53, UNASSIGN 2023-09-15 05:02:09,043 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a380112585ed77e225cde8778ad7d35c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:09,043 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fd943003763ef27ae50a9ccc96533d53, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:09,043 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754129043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754129043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754129043"}]},"ts":"1694754129043"} 2023-09-15 05:02:09,043 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754129043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754129043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754129043"}]},"ts":"1694754129043"} 2023-09-15 05:02:09,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure a380112585ed77e225cde8778ad7d35c, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:09,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure fd943003763ef27ae50a9ccc96533d53, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:09,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 05:02:09,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:09,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:09,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a380112585ed77e225cde8778ad7d35c, disabling compactions & flushes 2023-09-15 05:02:09,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:09,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:09,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. after waiting 0 ms 2023-09-15 05:02:09,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:09,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd943003763ef27ae50a9ccc96533d53, disabling compactions & flushes 2023-09-15 05:02:09,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a380112585ed77e225cde8778ad7d35c 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-15 05:02:09,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:09,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:09,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. after waiting 0 ms 2023-09-15 05:02:09,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:09,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fd943003763ef27ae50a9ccc96533d53 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-15 05:02:09,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/.tmp/cf/a93e89876480491fbb090e199eb48ba0 2023-09-15 05:02:09,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/.tmp/cf/448c2387f130493ab5cb8f4657a6783e 2023-09-15 05:02:09,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/.tmp/cf/a93e89876480491fbb090e199eb48ba0 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf/a93e89876480491fbb090e199eb48ba0 2023-09-15 05:02:09,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/.tmp/cf/448c2387f130493ab5cb8f4657a6783e as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf/448c2387f130493ab5cb8f4657a6783e 2023-09-15 05:02:09,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf/448c2387f130493ab5cb8f4657a6783e, entries=1, sequenceid=5, filesize=4.7 K 2023-09-15 05:02:09,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf/a93e89876480491fbb090e199eb48ba0, entries=1, sequenceid=5, filesize=4.7 K 2023-09-15 05:02:09,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for fd943003763ef27ae50a9ccc96533d53 in 22ms, sequenceid=5, compaction requested=false 2023-09-15 05:02:09,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-15 05:02:09,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a380112585ed77e225cde8778ad7d35c in 26ms, sequenceid=5, compaction requested=false 2023-09-15 05:02:09,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-15 05:02:09,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-15 05:02:09,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:09,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53. 2023-09-15 05:02:09,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd943003763ef27ae50a9ccc96533d53: 2023-09-15 05:02:09,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:09,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c. 2023-09-15 05:02:09,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a380112585ed77e225cde8778ad7d35c: 2023-09-15 05:02:09,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:09,234 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fd943003763ef27ae50a9ccc96533d53, regionState=CLOSED 2023-09-15 05:02:09,234 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754129234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754129234"}]},"ts":"1694754129234"} 2023-09-15 05:02:09,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:09,235 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a380112585ed77e225cde8778ad7d35c, regionState=CLOSED 2023-09-15 05:02:09,235 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694754129235"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754129235"}]},"ts":"1694754129235"} 2023-09-15 05:02:09,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-15 05:02:09,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure fd943003763ef27ae50a9ccc96533d53, server=jenkins-hbase4.apache.org,35769,1694754055535 in 191 msec 2023-09-15 05:02:09,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-15 05:02:09,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure a380112585ed77e225cde8778ad7d35c, server=jenkins-hbase4.apache.org,36615,1694754055486 in 192 msec 2023-09-15 05:02:09,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd943003763ef27ae50a9ccc96533d53, UNASSIGN in 196 msec 2023-09-15 05:02:09,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-15 05:02:09,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a380112585ed77e225cde8778ad7d35c, UNASSIGN in 200 msec 2023-09-15 05:02:09,283 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-15 05:02:09,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128382.a380112585ed77e225cde8778ad7d35c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:09,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694754128382.fd943003763ef27ae50a9ccc96533d53.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:09,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:09,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 05:02:09,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77480f47085a0555ae8944b4f1c8e15f, ASSIGN}] 2023-09-15 05:02:09,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77480f47085a0555ae8944b4f1c8e15f, ASSIGN 2023-09-15 05:02:09,333 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77480f47085a0555ae8944b4f1c8e15f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,36615,1694754055486; forceNewPlan=false, retain=false 2023-09-15 05:02:09,483 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 05:02:09,485 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=77480f47085a0555ae8944b4f1c8e15f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:09,485 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694754129485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754129485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754129485"}]},"ts":"1694754129485"} 2023-09-15 05:02:09,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 77480f47085a0555ae8944b4f1c8e15f, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:09,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 05:02:09,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:09,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77480f47085a0555ae8944b4f1c8e15f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.', STARTKEY => '', ENDKEY => ''} 2023-09-15 05:02:09,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. service=AccessControlService 2023-09-15 05:02:09,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:09,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:09,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:09,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:09,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:09,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/.regioninfo 2023-09-15 05:02:09,651 INFO [StoreOpener-77480f47085a0555ae8944b4f1c8e15f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:09,652 DEBUG [StoreOpener-77480f47085a0555ae8944b4f1c8e15f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf 2023-09-15 05:02:09,652 DEBUG [StoreOpener-77480f47085a0555ae8944b4f1c8e15f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf 2023-09-15 05:02:09,653 INFO [StoreOpener-77480f47085a0555ae8944b4f1c8e15f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77480f47085a0555ae8944b4f1c8e15f columnFamilyName cf 2023-09-15 05:02:09,679 DEBUG [StoreOpener-77480f47085a0555ae8944b4f1c8e15f-1] regionserver.HStore(539): loaded hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/448c2387f130493ab5cb8f4657a6783e.fd943003763ef27ae50a9ccc96533d53->hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf/448c2387f130493ab5cb8f4657a6783e-top 2023-09-15 05:02:09,684 DEBUG [StoreOpener-77480f47085a0555ae8944b4f1c8e15f-1] regionserver.HStore(539): loaded hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/a93e89876480491fbb090e199eb48ba0.a380112585ed77e225cde8778ad7d35c->hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf/a93e89876480491fbb090e199eb48ba0-top 2023-09-15 05:02:09,684 INFO [StoreOpener-77480f47085a0555ae8944b4f1c8e15f-1] regionserver.HStore(310): Store=77480f47085a0555ae8944b4f1c8e15f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:09,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:09,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:09,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:09,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 77480f47085a0555ae8944b4f1c8e15f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66783974, jitterRate=-0.004841238260269165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:09,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 77480f47085a0555ae8944b4f1c8e15f: 2023-09-15 05:02:09,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f., pid=77, masterSystemTime=1694754129638 2023-09-15 05:02:09,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.,because compaction is disabled. 2023-09-15 05:02:09,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:09,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:09,694 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=77480f47085a0555ae8944b4f1c8e15f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:09,694 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694754129694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754129694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754129694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754129694"}]},"ts":"1694754129694"} 2023-09-15 05:02:09,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-15 05:02:09,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 77480f47085a0555ae8944b4f1c8e15f, server=jenkins-hbase4.apache.org,36615,1694754055486 in 208 msec 2023-09-15 05:02:09,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-15 05:02:09,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77480f47085a0555ae8944b4f1c8e15f, ASSIGN in 366 msec 2023-09-15 05:02:09,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a380112585ed77e225cde8778ad7d35c, fd943003763ef27ae50a9ccc96533d53], force=true in 685 msec 2023-09-15 05:02:10,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 05:02:10,127 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-15 05:02:10,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 05:02:10,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754130127 (current time:1694754130127). 2023-09-15 05:02:10,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:02:10,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x6dcf6797 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:10,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@589e438a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:10,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:10,138 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:10,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dcf6797 to 127.0.0.1:60709 2023-09-15 05:02:10,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:10,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x4c60d898 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:10,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a85ed5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:10,146 DEBUG [hconnection-0x70ad6795-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:10,148 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:10,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:10,154 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:10,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c60d898 to 127.0.0.1:60709 2023-09-15 05:02:10,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:10,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-15 05:02:10,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:02:10,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 05:02:10,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 05:02:10,159 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 05:02:10,160 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694754730160 2023-09-15 05:02:10,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 05:02:10,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,163 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:02:10,163 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:02:10,164 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 05:02:10,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 05:02:10,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-15 05:02:10,166 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 05:02:10,166 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694754730166 2023-09-15 05:02:10,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,175 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-15 05:02:10,175 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:10,176 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-15 05:02:10,176 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-15 05:02:10,176 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,176 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,178 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:10,178 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:10,178 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,178 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:10,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:10,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:10,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:10,178 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,178 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:02:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 05:02:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 05:02:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:10,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 05:02:10,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 05:02:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 05:02:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 05:02:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 05:02:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 05:02:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 05:02:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 05:02:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 05:02:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 05:02:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 05:02:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,185 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:10,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-15 05:02:10,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2493816d[Count = 0] remaining members to acquire global barrier 2023-09-15 05:02:10,187 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-15 05:02:10,187 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,188 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 05:02:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,189 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:02:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:10,189 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 05:02:10,189 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. started... 2023-09-15 05:02:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:02:10,190 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 77480f47085a0555ae8944b4f1c8e15f: 2023-09-15 05:02:10,190 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,190 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:10,190 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/448c2387f130493ab5cb8f4657a6783e.fd943003763ef27ae50a9ccc96533d53->hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf/448c2387f130493ab5cb8f4657a6783e-top, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/a93e89876480491fbb090e199eb48ba0.a380112585ed77e225cde8778ad7d35c->hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf/a93e89876480491fbb090e199eb48ba0-top] hfiles 2023-09-15 05:02:10,190 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/448c2387f130493ab5cb8f4657a6783e.fd943003763ef27ae50a9ccc96533d53 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 05:02:10,191 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/a93e89876480491fbb090e199eb48ba0.a380112585ed77e225cde8778ad7d35c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 05:02:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 05:02:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 05:02:10,201 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. completed. 2023-09-15 05:02:10,201 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 05:02:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:02:10,209 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 05:02:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:10,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:10,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 05:02:10,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:10,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:10,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:02:10,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-15 05:02:10,212 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-15 05:02:10,212 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:02:10,212 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:02:10,212 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,212 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:02:10,213 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,213 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,213 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:10,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,213 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,213 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:10,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,213 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:10,214 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,214 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,214 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:10,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,215 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,217 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:10,217 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,218 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:10,221 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:10,221 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:10,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:10,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:10,220 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:10,220 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:10,221 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:10,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:10,221 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:10,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:10,221 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:10,221 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:10,222 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,222 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:10,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-15 05:02:10,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694754130160Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694754130221 (+61 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694754130221Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694754130224 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694754130232 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694754130239 (+7 ms) 2023-09-15 05:02:10,242 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 05:02:10,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 79 msec 2023-09-15 05:02:10,263 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:10,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-15 05:02:10,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:02:10,264 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264 2023-09-15 05:02:10,265 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41743, tgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264, rawTgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264, srcFsUri=hdfs://localhost:41743, srcDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:02:10,298 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:02:10,298 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_664368785_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,298 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, snapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-15 05:02:10,307 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:10,325 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:10,325 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:10,326 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:10,326 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:10,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0004_000001 (auth:SIMPLE) 2023-09-15 05:02:11,201 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-4739172593369060561.jar 2023-09-15 05:02:11,201 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,202 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,268 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-4108453855908693913.jar 2023-09-15 05:02:11,268 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,269 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,269 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,270 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,270 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,270 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:11,271 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 05:02:11,271 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 05:02:11,271 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 05:02:11,272 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 05:02:11,272 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 05:02:11,273 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 05:02:11,273 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 05:02:11,273 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 05:02:11,273 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 05:02:11,274 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 05:02:11,275 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:11,275 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:11,275 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:11,276 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:11,276 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:11,276 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:11,277 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:11,634 WARN [Listener at jenkins-hbase4.apache.org/33501] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 05:02:11,636 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-15 05:02:11,639 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-15 05:02:11,692 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:02:11,692 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:02:11,866 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0005_000001 (auth:SIMPLE) 2023-09-15 05:02:12,529 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:02:15,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0005_000001 (auth:SIMPLE) 2023-09-15 05:02:17,728 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0005_000001 (auth:SIMPLE) 2023-09-15 05:02:19,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0005_000001 (auth:SIMPLE) 2023-09-15 05:02:21,790 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 05:02:21,792 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 05:02:21,800 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:21,801 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 05:02:21,801 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 05:02:21,801 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:21,802 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-15 05:02:21,802 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-15 05:02:21,802 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:21,802 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-15 05:02:21,802 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754130264/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-15 05:02:21,808 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:21,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:21,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:21,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 05:02:21,812 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754141812"}]},"ts":"1694754141812"} 2023-09-15 05:02:21,814 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-15 05:02:21,815 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-15 05:02:21,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77480f47085a0555ae8944b4f1c8e15f, UNASSIGN}] 2023-09-15 05:02:21,818 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77480f47085a0555ae8944b4f1c8e15f, UNASSIGN 2023-09-15 05:02:21,818 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=77480f47085a0555ae8944b4f1c8e15f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:21,818 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694754141818"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754141818"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754141818"}]},"ts":"1694754141818"} 2023-09-15 05:02:21,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 77480f47085a0555ae8944b4f1c8e15f, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:21,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 05:02:21,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:21,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 77480f47085a0555ae8944b4f1c8e15f, disabling compactions & flushes 2023-09-15 05:02:21,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:21,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:21,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. after waiting 0 ms 2023-09-15 05:02:21,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:21,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-15 05:02:21,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:21,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f. 2023-09-15 05:02:21,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 77480f47085a0555ae8944b4f1c8e15f: 2023-09-15 05:02:21,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:21,985 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=77480f47085a0555ae8944b4f1c8e15f, regionState=CLOSED 2023-09-15 05:02:21,985 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694754141985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754141985"}]},"ts":"1694754141985"} 2023-09-15 05:02:21,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-15 05:02:21,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 77480f47085a0555ae8944b4f1c8e15f, server=jenkins-hbase4.apache.org,36615,1694754055486 in 167 msec 2023-09-15 05:02:21,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-15 05:02:21,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77480f47085a0555ae8944b4f1c8e15f, UNASSIGN in 172 msec 2023-09-15 05:02:21,989 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754141989"}]},"ts":"1694754141989"} 2023-09-15 05:02:21,990 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-15 05:02:21,992 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-15 05:02:21,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 184 msec 2023-09-15 05:02:22,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 05:02:22,114 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-15 05:02:22,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,118 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,120 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,123 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:22,123 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:22,123 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:22,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,124 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,124 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,123 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 05:02:22,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 05:02:22,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 05:02:22,125 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,125 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,125 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-15 05:02:22,125 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 05:02:22,125 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,125 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,125 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,125 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,125 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/recovered.edits] 2023-09-15 05:02:22,125 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,126 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/recovered.edits] 2023-09-15 05:02:22,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:22,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:22,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:22,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-15 05:02:22,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:22,129 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/recovered.edits] 2023-09-15 05:02:22,132 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/448c2387f130493ab5cb8f4657a6783e.fd943003763ef27ae50a9ccc96533d53 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/448c2387f130493ab5cb8f4657a6783e.fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:22,132 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf/448c2387f130493ab5cb8f4657a6783e to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/cf/448c2387f130493ab5cb8f4657a6783e 2023-09-15 05:02:22,133 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/a93e89876480491fbb090e199eb48ba0.a380112585ed77e225cde8778ad7d35c to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/cf/a93e89876480491fbb090e199eb48ba0.a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:22,133 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf/a93e89876480491fbb090e199eb48ba0 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/cf/a93e89876480491fbb090e199eb48ba0 2023-09-15 05:02:22,135 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/recovered.edits/8.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53/recovered.edits/8.seqid 2023-09-15 05:02:22,136 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd943003763ef27ae50a9ccc96533d53 2023-09-15 05:02:22,137 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/recovered.edits/12.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f/recovered.edits/12.seqid 2023-09-15 05:02:22,137 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/recovered.edits/8.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c/recovered.edits/8.seqid 2023-09-15 05:02:22,137 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77480f47085a0555ae8944b4f1c8e15f 2023-09-15 05:02:22,137 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a380112585ed77e225cde8778ad7d35c 2023-09-15 05:02:22,138 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-15 05:02:22,140 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,142 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-15 05:02:22,143 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-15 05:02:22,144 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,144 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-15 05:02:22,144 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754142144"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:22,146 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-15 05:02:22,146 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 77480f47085a0555ae8944b4f1c8e15f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694754128383.77480f47085a0555ae8944b4f1c8e15f.', STARTKEY => '', ENDKEY => ''}] 2023-09-15 05:02:22,146 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-15 05:02:22,146 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694754142146"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:22,148 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-15 05:02:22,149 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-15 05:02:22,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-15 05:02:22,228 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-15 05:02:22,228 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 05:02:22,233 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754142233"}]},"ts":"1694754142233"} 2023-09-15 05:02:22,234 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-15 05:02:22,235 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-15 05:02:22,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f436aea906fc25b0a281f81e370abffe, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d5418e5d18979349fc7e307e6b8f789, UNASSIGN}] 2023-09-15 05:02:22,238 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f436aea906fc25b0a281f81e370abffe, UNASSIGN 2023-09-15 05:02:22,238 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d5418e5d18979349fc7e307e6b8f789, UNASSIGN 2023-09-15 05:02:22,238 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2d5418e5d18979349fc7e307e6b8f789, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:22,238 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f436aea906fc25b0a281f81e370abffe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:22,239 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754142238"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754142238"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754142238"}]},"ts":"1694754142238"} 2023-09-15 05:02:22,239 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754142238"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754142238"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754142238"}]},"ts":"1694754142238"} 2023-09-15 05:02:22,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure f436aea906fc25b0a281f81e370abffe, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:22,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 2d5418e5d18979349fc7e307e6b8f789, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:22,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 05:02:22,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:22,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f436aea906fc25b0a281f81e370abffe, disabling compactions & flushes 2023-09-15 05:02:22,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:22,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:22,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. after waiting 0 ms 2023-09-15 05:02:22,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:22,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:22,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d5418e5d18979349fc7e307e6b8f789, disabling compactions & flushes 2023-09-15 05:02:22,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:22,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:22,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. after waiting 0 ms 2023-09-15 05:02:22,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:22,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:22,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:22,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe. 2023-09-15 05:02:22,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f436aea906fc25b0a281f81e370abffe: 2023-09-15 05:02:22,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:22,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:22,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789. 2023-09-15 05:02:22,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d5418e5d18979349fc7e307e6b8f789: 2023-09-15 05:02:22,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:22,410 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f436aea906fc25b0a281f81e370abffe, regionState=CLOSED 2023-09-15 05:02:22,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754142410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754142410"}]},"ts":"1694754142410"} 2023-09-15 05:02:22,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:22,411 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2d5418e5d18979349fc7e307e6b8f789, regionState=CLOSED 2023-09-15 05:02:22,411 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694754142411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754142411"}]},"ts":"1694754142411"} 2023-09-15 05:02:22,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-15 05:02:22,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure f436aea906fc25b0a281f81e370abffe, server=jenkins-hbase4.apache.org,36615,1694754055486 in 171 msec 2023-09-15 05:02:22,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-15 05:02:22,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 2d5418e5d18979349fc7e307e6b8f789, server=jenkins-hbase4.apache.org,35769,1694754055535 in 171 msec 2023-09-15 05:02:22,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f436aea906fc25b0a281f81e370abffe, UNASSIGN in 177 msec 2023-09-15 05:02:22,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-15 05:02:22,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d5418e5d18979349fc7e307e6b8f789, UNASSIGN in 178 msec 2023-09-15 05:02:22,416 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754142416"}]},"ts":"1694754142416"} 2023-09-15 05:02:22,417 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-15 05:02:22,419 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-15 05:02:22,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 191 msec 2023-09-15 05:02:22,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 05:02:22,534 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-15 05:02:22,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,538 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,539 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,540 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,542 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,542 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,542 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,542 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 05:02:22,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 05:02:22,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 05:02:22,543 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:22,543 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:22,543 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,543 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-15 05:02:22,543 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,543 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,543 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,544 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 05:02:22,544 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:22,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-15 05:02:22,545 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/recovered.edits] 2023-09-15 05:02:22,545 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/recovered.edits] 2023-09-15 05:02:22,549 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf/970b8501e590486f9ebf8f1b42f951f3 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/cf/970b8501e590486f9ebf8f1b42f951f3 2023-09-15 05:02:22,549 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf/cd3cdc96608c4fc182ded62a5bd76c52 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/cf/cd3cdc96608c4fc182ded62a5bd76c52 2023-09-15 05:02:22,552 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789/recovered.edits/9.seqid 2023-09-15 05:02:22,552 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe/recovered.edits/9.seqid 2023-09-15 05:02:22,553 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d5418e5d18979349fc7e307e6b8f789 2023-09-15 05:02:22,553 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f436aea906fc25b0a281f81e370abffe 2023-09-15 05:02:22,553 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-15 05:02:22,553 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-15 05:02:22,554 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-15 05:02:22,557 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309152689e0302dcf4f52b3db7a181d379ad2 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309152689e0302dcf4f52b3db7a181d379ad2 2023-09-15 05:02:22,558 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091589ab1ba7e3e1437898e4e9ddfb5ac437 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091589ab1ba7e3e1437898e4e9ddfb5ac437 2023-09-15 05:02:22,558 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-15 05:02:22,560 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,562 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-15 05:02:22,564 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-15 05:02:22,565 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,565 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-15 05:02:22,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754142565"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:22,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754142565"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:22,566 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 05:02:22,566 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f436aea906fc25b0a281f81e370abffe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694754127228.f436aea906fc25b0a281f81e370abffe.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2d5418e5d18979349fc7e307e6b8f789, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694754127228.2d5418e5d18979349fc7e307e6b8f789.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 05:02:22,566 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-15 05:02:22,566 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694754142566"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:22,568 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-15 05:02:22,570 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-15 05:02:22,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-15 05:02:22,646 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-15 05:02:22,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-15 05:02:22,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-15 05:02:22,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 05:02:22,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-15 05:02:22,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 05:02:22,684 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-368448597_1 at /127.0.0.1:53994 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4073 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:54024 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:35974 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:41113 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:46940 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 250), ProcessCount=168 (was 168), AvailableMemoryMB=8247 (was 8345) 2023-09-15 05:02:22,684 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-15 05:02:22,702 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=168, AvailableMemoryMB=8246 2023-09-15 05:02:22,702 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-15 05:02:22,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 05:02:22,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:22,706 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:02:22,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-15 05:02:22,707 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:02:22,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 05:02:22,709 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:22,709 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:22,709 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8 empty. 2023-09-15 05:02:22,709 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859 empty. 2023-09-15 05:02:22,710 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:22,710 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:22,710 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-15 05:02:22,718 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-15 05:02:22,719 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93820a2072c27f252dafee2fe6580fd8, NAME => 'testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:22,720 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 31bf3a9b2b66069eb69f8c359c73f859, NAME => 'testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 93820a2072c27f252dafee2fe6580fd8, disabling compactions & flushes 2023-09-15 05:02:22,727 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. after waiting 0 ms 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:22,727 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 93820a2072c27f252dafee2fe6580fd8: 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:22,727 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 31bf3a9b2b66069eb69f8c359c73f859, disabling compactions & flushes 2023-09-15 05:02:22,727 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:22,728 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:22,728 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. after waiting 0 ms 2023-09-15 05:02:22,728 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:22,728 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:22,728 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 31bf3a9b2b66069eb69f8c359c73f859: 2023-09-15 05:02:22,730 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:02:22,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754142731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754142731"}]},"ts":"1694754142731"} 2023-09-15 05:02:22,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754142731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754142731"}]},"ts":"1694754142731"} 2023-09-15 05:02:22,733 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 05:02:22,734 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:02:22,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754142734"}]},"ts":"1694754142734"} 2023-09-15 05:02:22,735 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-15 05:02:22,738 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:02:22,739 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:02:22,739 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:02:22,739 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:02:22,739 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:02:22,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93820a2072c27f252dafee2fe6580fd8, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=31bf3a9b2b66069eb69f8c359c73f859, ASSIGN}] 2023-09-15 05:02:22,741 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=31bf3a9b2b66069eb69f8c359c73f859, ASSIGN 2023-09-15 05:02:22,741 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93820a2072c27f252dafee2fe6580fd8, ASSIGN 2023-09-15 05:02:22,742 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=31bf3a9b2b66069eb69f8c359c73f859, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36615,1694754055486; forceNewPlan=false, retain=false 2023-09-15 05:02:22,742 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93820a2072c27f252dafee2fe6580fd8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35769,1694754055535; forceNewPlan=false, retain=false 2023-09-15 05:02:22,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 05:02:22,892 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 05:02:22,894 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=31bf3a9b2b66069eb69f8c359c73f859, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:22,894 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=93820a2072c27f252dafee2fe6580fd8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:22,895 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754142894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754142894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754142894"}]},"ts":"1694754142894"} 2023-09-15 05:02:22,895 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754142894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754142894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754142894"}]},"ts":"1694754142894"} 2023-09-15 05:02:22,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 31bf3a9b2b66069eb69f8c359c73f859, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:22,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 93820a2072c27f252dafee2fe6580fd8, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:23,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 05:02:23,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31bf3a9b2b66069eb69f8c359c73f859, NAME => 'testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 05:02:23,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93820a2072c27f252dafee2fe6580fd8, NAME => 'testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. service=AccessControlService 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. service=AccessControlService 2023-09-15 05:02:23,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:23,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:23,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:23,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:23,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:23,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:23,053 INFO [StoreOpener-31bf3a9b2b66069eb69f8c359c73f859-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:23,053 INFO [StoreOpener-93820a2072c27f252dafee2fe6580fd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:23,054 DEBUG [StoreOpener-93820a2072c27f252dafee2fe6580fd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf 2023-09-15 05:02:23,054 DEBUG [StoreOpener-31bf3a9b2b66069eb69f8c359c73f859-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf 2023-09-15 05:02:23,054 DEBUG [StoreOpener-31bf3a9b2b66069eb69f8c359c73f859-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf 2023-09-15 05:02:23,054 DEBUG [StoreOpener-93820a2072c27f252dafee2fe6580fd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf 2023-09-15 05:02:23,055 INFO [StoreOpener-31bf3a9b2b66069eb69f8c359c73f859-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31bf3a9b2b66069eb69f8c359c73f859 columnFamilyName cf 2023-09-15 05:02:23,055 INFO [StoreOpener-93820a2072c27f252dafee2fe6580fd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93820a2072c27f252dafee2fe6580fd8 columnFamilyName cf 2023-09-15 05:02:23,056 INFO [StoreOpener-31bf3a9b2b66069eb69f8c359c73f859-1] regionserver.HStore(310): Store=31bf3a9b2b66069eb69f8c359c73f859/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:23,056 INFO [StoreOpener-93820a2072c27f252dafee2fe6580fd8-1] regionserver.HStore(310): Store=93820a2072c27f252dafee2fe6580fd8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:23,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:23,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:23,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:23,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:23,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:23,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:23,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:23,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:23,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 31bf3a9b2b66069eb69f8c359c73f859; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63349466, jitterRate=-0.05601939558982849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:23,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 31bf3a9b2b66069eb69f8c359c73f859: 2023-09-15 05:02:23,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 93820a2072c27f252dafee2fe6580fd8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64210675, jitterRate=-0.043186381459236145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:23,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 93820a2072c27f252dafee2fe6580fd8: 2023-09-15 05:02:23,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859., pid=93, masterSystemTime=1694754143048 2023-09-15 05:02:23,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8., pid=94, masterSystemTime=1694754143048 2023-09-15 05:02:23,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:23,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:23,066 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=31bf3a9b2b66069eb69f8c359c73f859, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,066 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754143065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754143065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754143065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754143065"}]},"ts":"1694754143065"} 2023-09-15 05:02:23,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,066 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=93820a2072c27f252dafee2fe6580fd8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,066 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754143066"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754143066"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754143066"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754143066"}]},"ts":"1694754143066"} 2023-09-15 05:02:23,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-15 05:02:23,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 31bf3a9b2b66069eb69f8c359c73f859, server=jenkins-hbase4.apache.org,36615,1694754055486 in 171 msec 2023-09-15 05:02:23,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-15 05:02:23,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 93820a2072c27f252dafee2fe6580fd8, server=jenkins-hbase4.apache.org,35769,1694754055535 in 171 msec 2023-09-15 05:02:23,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=31bf3a9b2b66069eb69f8c359c73f859, ASSIGN in 330 msec 2023-09-15 05:02:23,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-15 05:02:23,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93820a2072c27f252dafee2fe6580fd8, ASSIGN in 331 msec 2023-09-15 05:02:23,072 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:02:23,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754143072"}]},"ts":"1694754143072"} 2023-09-15 05:02:23,073 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-15 05:02:23,075 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:02:23,075 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-15 05:02:23,077 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 05:02:23,079 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:23,079 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:23,079 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:23,079 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:23,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:23,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:23,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:23,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:23,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 377 msec 2023-09-15 05:02:23,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 05:02:23,310 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-15 05:02:23,312 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-15 05:02:23,312 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,315 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:02:23,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:02:23,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754143327 (current time:1694754143327). 2023-09-15 05:02:23,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:02:23,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x0690e106 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:23,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71989685, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:23,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:23,337 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:23,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0690e106 to 127.0.0.1:60709 2023-09-15 05:02:23,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:23,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x0b45feb2 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:23,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a5ca60d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:23,346 DEBUG [hconnection-0x3f45357d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:23,349 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:23,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:23,354 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:23,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b45feb2 to 127.0.0.1:60709 2023-09-15 05:02:23,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:23,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 05:02:23,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:02:23,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:02:23,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:02:23,358 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:02:23,359 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694754743359 2023-09-15 05:02:23,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:02:23,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-15 05:02:23,360 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:02:23,360 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:02:23,361 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:02:23,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 05:02:23,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-15 05:02:23,365 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 05:02:23,365 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694754743365 2023-09-15 05:02:23,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,374 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-15 05:02:23,374 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,376 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-15 05:02:23,376 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-15 05:02:23,376 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,376 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,382 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,382 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,382 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,382 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,382 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,382 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,383 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,384 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 05:02:23,384 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 05:02:23,384 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 05:02:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 05:02:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 05:02:23,386 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 05:02:23,386 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 05:02:23,386 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 05:02:23,387 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 05:02:23,387 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 05:02:23,386 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 05:02:23,387 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 05:02:23,387 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 05:02:23,388 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,389 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,389 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,389 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,389 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,389 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,390 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:23,390 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,390 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:23,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 05:02:23,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31aa2e2a[Count = 1] remaining members to acquire global barrier 2023-09-15 05:02:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 05:02:23,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31aa2e2a[Count = 0] remaining members to acquire global barrier 2023-09-15 05:02:23,396 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 05:02:23,396 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,398 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:02:23,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:23,399 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,399 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:02:23,399 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:23,399 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. started... 2023-09-15 05:02:23,399 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:02:23,399 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. started... 2023-09-15 05:02:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:23,399 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93820a2072c27f252dafee2fe6580fd8: 2023-09-15 05:02:23,400 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31bf3a9b2b66069eb69f8c359c73f859: 2023-09-15 05:02:23,400 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,400 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,401 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:23,401 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:23,401 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:02:23,401 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:02:23,401 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 05:02:23,402 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,402 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 05:02:23,410 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. completed. 2023-09-15 05:02:23,410 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. completed. 2023-09-15 05:02:23,410 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,410 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 05:02:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:02:23,412 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 05:02:23,412 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 05:02:23,412 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,412 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,412 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 05:02:23,412 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,412 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 05:02:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,414 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:02:23,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 05:02:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:02:23,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 05:02:23,420 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-15 05:02:23,420 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:02:23,420 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:02:23,420 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,420 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:02:23,422 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,422 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,423 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,423 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,425 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,425 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,425 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,429 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,429 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,431 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 05:02:23,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,454 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-15 05:02:23,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,454 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694754143359Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694754143438 (+79 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694754143438Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694754143438Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694754143442 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694754143448 (+6 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694754143454 (+6 ms) 2023-09-15 05:02:23,457 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 05:02:23,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 97 msec 2023-09-15 05:02:23,460 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:23,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 05:02:23,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:02:23,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35769] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:02:23,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36615] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:02:23,467 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-15 05:02:23,467 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,467 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:02:23,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:02:23,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754143477 (current time:1694754143477). 2023-09-15 05:02:23,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:02:23,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x349740f2 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:23,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@226f65c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:23,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:23,486 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:23,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x349740f2 to 127.0.0.1:60709 2023-09-15 05:02:23,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:23,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x2070460a to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:23,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eee1226, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:23,496 DEBUG [hconnection-0x7776235e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:23,497 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:23,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:23,501 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:23,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2070460a to 127.0.0.1:60709 2023-09-15 05:02:23,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:23,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 05:02:23,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:02:23,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:02:23,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:02:23,506 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:02:23,506 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694754743506 2023-09-15 05:02:23,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 05:02:23,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-15 05:02:23,507 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:02:23,507 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:02:23,508 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 05:02:23,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 05:02:23,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-15 05:02:23,510 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 05:02:23,511 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694754743511 2023-09-15 05:02:23,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,519 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-15 05:02:23,519 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,520 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-15 05:02:23,520 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-15 05:02:23,520 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,520 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,521 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,521 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,521 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,521 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,522 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,522 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,522 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,522 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 05:02:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 05:02:23,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,523 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 05:02:23,523 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 05:02:23,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 05:02:23,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 05:02:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 05:02:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 05:02:23,524 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 05:02:23,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 05:02:23,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,524 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 05:02:23,524 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,525 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 05:02:23,525 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 05:02:23,525 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:23,525 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 05:02:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 05:02:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 05:02:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 05:02:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 05:02:23,529 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,529 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,530 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,530 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,531 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,531 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,531 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,532 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:23,531 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:23,532 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,532 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:23,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64d49f99[Count = 1] remaining members to acquire global barrier 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 05:02:23,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64d49f99[Count = 0] remaining members to acquire global barrier 2023-09-15 05:02:23,535 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 05:02:23,535 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,538 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:02:23,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:23,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,539 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. started... 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 05:02:23,539 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,539 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 05:02:23,539 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 93820a2072c27f252dafee2fe6580fd8 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:23,539 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:23,539 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:23,539 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. started... 2023-09-15 05:02:23,540 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 31bf3a9b2b66069eb69f8c359c73f859 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-15 05:02:23,541 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 05:02:23,541 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,541 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 05:02:23,557 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915f447a13f175144258eb2e2e39e61c29a to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915f447a13f175144258eb2e2e39e61c29a 2023-09-15 05:02:23,558 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230915d42e2459e6454817a3a4cfda3e397446 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915d42e2459e6454817a3a4cfda3e397446 2023-09-15 05:02:23,564 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/.tmp/cf/fa088e36d1b14afe985cc6a84092cfdc 2023-09-15 05:02:23,565 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/.tmp/cf/d1f415d7c1f24447bd3fffc614b5c0fb 2023-09-15 05:02:23,569 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/.tmp/cf/fa088e36d1b14afe985cc6a84092cfdc as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf/fa088e36d1b14afe985cc6a84092cfdc 2023-09-15 05:02:23,570 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/.tmp/cf/d1f415d7c1f24447bd3fffc614b5c0fb as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf/d1f415d7c1f24447bd3fffc614b5c0fb 2023-09-15 05:02:23,574 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf/d1f415d7c1f24447bd3fffc614b5c0fb, entries=46, sequenceid=6, filesize=12.9 K 2023-09-15 05:02:23,574 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf/fa088e36d1b14afe985cc6a84092cfdc, entries=4, sequenceid=6, filesize=5.6 K 2023-09-15 05:02:23,575 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 93820a2072c27f252dafee2fe6580fd8 in 36ms, sequenceid=6, compaction requested=false 2023-09-15 05:02:23,575 INFO [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 31bf3a9b2b66069eb69f8c359c73f859 in 35ms, sequenceid=6, compaction requested=false 2023-09-15 05:02:23,575 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-15 05:02:23,575 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-15 05:02:23,578 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93820a2072c27f252dafee2fe6580fd8: 2023-09-15 05:02:23,578 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31bf3a9b2b66069eb69f8c359c73f859: 2023-09-15 05:02:23,579 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,579 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,579 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:23,580 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:23,580 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf/fa088e36d1b14afe985cc6a84092cfdc] hfiles 2023-09-15 05:02:23,580 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf/d1f415d7c1f24447bd3fffc614b5c0fb] hfiles 2023-09-15 05:02:23,580 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf/fa088e36d1b14afe985cc6a84092cfdc for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,580 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf/d1f415d7c1f24447bd3fffc614b5c0fb for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,596 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. completed. 2023-09-15 05:02:23,596 DEBUG [rs(jenkins-hbase4.apache.org,36615,1694754055486)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:23,597 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:23,597 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:23,597 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,597 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 05:02:23,597 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:02:23,599 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. completed. 2023-09-15 05:02:23,599 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 05:02:23,599 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:23,599 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,599 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:23,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,599 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,599 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:23,599 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 05:02:23,600 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,601 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 05:02:23,601 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:02:23,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,603 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,604 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 05:02:23,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,604 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,604 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 05:02:23,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36615,1694754055486': 2023-09-15 05:02:23,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 05:02:23,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,608 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:23,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 05:02:23,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:02:23,609 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:02:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:02:23,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 05:02:23,611 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-15 05:02:23,611 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:02:23,611 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:02:23,611 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,611 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:02:23,612 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,612 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,612 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:23,612 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,612 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,613 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,613 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:23,613 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,614 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:23,614 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:23,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,616 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,616 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,616 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,618 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,618 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,619 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,619 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,619 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,619 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:23,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-15 05:02:23,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:23,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,619 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,619 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,619 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,620 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:23,620 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:23,620 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,620 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,620 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,621 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:23,621 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:23,621 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:23,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:23,621 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915d42e2459e6454817a3a4cfda3e397446, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915f447a13f175144258eb2e2e39e61c29a] mob files 2023-09-15 05:02:23,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915d42e2459e6454817a3a4cfda3e397446 2023-09-15 05:02:23,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915f447a13f175144258eb2e2e39e61c29a 2023-09-15 05:02:23,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-15 05:02:23,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,644 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694754143506Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694754143627 (+121 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694754143627Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694754143627Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694754143630 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694754143637 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694754143644 (+7 ms) 2023-09-15 05:02:23,646 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 05:02:23,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 139 msec 2023-09-15 05:02:23,809 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:23,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 05:02:23,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:02:23,810 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810 2023-09-15 05:02:23,810 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41743, tgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810, rawTgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810, srcFsUri=hdfs://localhost:41743, srcDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:02:23,835 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:02:23,835 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1490727877_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,835 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, snapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-15 05:02:23,841 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:23,856 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:23,857 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:23,857 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:23,857 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,723 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-2463958519979020232.jar 2023-09-15 05:02:24,724 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,724 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,790 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-2313760172670789154.jar 2023-09-15 05:02:24,791 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,791 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,791 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,792 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,792 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,792 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:24,792 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 05:02:24,793 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 05:02:24,793 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 05:02:24,793 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 05:02:24,794 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 05:02:24,794 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 05:02:24,795 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 05:02:24,795 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 05:02:24,795 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 05:02:24,796 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 05:02:24,796 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:24,796 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:24,797 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:24,797 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:24,797 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:24,798 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:24,798 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:25,172 WARN [Listener at jenkins-hbase4.apache.org/33501] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 05:02:25,174 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-15 05:02:26,163 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:02:26,163 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:02:26,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0005_000001 (auth:SIMPLE) 2023-09-15 05:02:26,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0006_000001 (auth:SIMPLE) 2023-09-15 05:02:27,582 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:02:30,686 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0006_000001 (auth:SIMPLE) 2023-09-15 05:02:33,506 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 05:02:33,507 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 05:02:33,512 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:33,512 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 05:02:33,512 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 05:02:33,512 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:33,513 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-15 05:02:33,513 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-15 05:02:33,513 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:33,513 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-15 05:02:33,514 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754143810/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-15 05:02:33,518 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 05:02:33,522 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754153522"}]},"ts":"1694754153522"} 2023-09-15 05:02:33,524 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-15 05:02:33,525 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-15 05:02:33,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93820a2072c27f252dafee2fe6580fd8, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=31bf3a9b2b66069eb69f8c359c73f859, UNASSIGN}] 2023-09-15 05:02:33,530 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93820a2072c27f252dafee2fe6580fd8, UNASSIGN 2023-09-15 05:02:33,530 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=31bf3a9b2b66069eb69f8c359c73f859, UNASSIGN 2023-09-15 05:02:33,530 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=93820a2072c27f252dafee2fe6580fd8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:33,530 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=31bf3a9b2b66069eb69f8c359c73f859, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:33,530 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754153530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754153530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754153530"}]},"ts":"1694754153530"} 2023-09-15 05:02:33,530 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754153530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754153530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754153530"}]},"ts":"1694754153530"} 2023-09-15 05:02:33,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 93820a2072c27f252dafee2fe6580fd8, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:33,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 31bf3a9b2b66069eb69f8c359c73f859, server=jenkins-hbase4.apache.org,36615,1694754055486}] 2023-09-15 05:02:33,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 05:02:33,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:33,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 93820a2072c27f252dafee2fe6580fd8, disabling compactions & flushes 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 31bf3a9b2b66069eb69f8c359c73f859, disabling compactions & flushes 2023-09-15 05:02:33,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:33,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. after waiting 0 ms 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. after waiting 0 ms 2023-09-15 05:02:33,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:33,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:33,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:33,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:33,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:33,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8. 2023-09-15 05:02:33,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859. 2023-09-15 05:02:33,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 93820a2072c27f252dafee2fe6580fd8: 2023-09-15 05:02:33,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 31bf3a9b2b66069eb69f8c359c73f859: 2023-09-15 05:02:33,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:33,696 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=31bf3a9b2b66069eb69f8c359c73f859, regionState=CLOSED 2023-09-15 05:02:33,696 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754153696"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754153696"}]},"ts":"1694754153696"} 2023-09-15 05:02:33,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:33,696 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=93820a2072c27f252dafee2fe6580fd8, regionState=CLOSED 2023-09-15 05:02:33,696 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694754153696"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754153696"}]},"ts":"1694754153696"} 2023-09-15 05:02:33,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-15 05:02:33,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 31bf3a9b2b66069eb69f8c359c73f859, server=jenkins-hbase4.apache.org,36615,1694754055486 in 164 msec 2023-09-15 05:02:33,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-15 05:02:33,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 93820a2072c27f252dafee2fe6580fd8, server=jenkins-hbase4.apache.org,35769,1694754055535 in 166 msec 2023-09-15 05:02:33,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=31bf3a9b2b66069eb69f8c359c73f859, UNASSIGN in 174 msec 2023-09-15 05:02:33,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-15 05:02:33,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93820a2072c27f252dafee2fe6580fd8, UNASSIGN in 174 msec 2023-09-15 05:02:33,701 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754153701"}]},"ts":"1694754153701"} 2023-09-15 05:02:33,702 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-15 05:02:33,703 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-15 05:02:33,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-09-15 05:02:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 05:02:33,824 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-15 05:02:33,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,828 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,828 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,830 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,832 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:33,832 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:33,833 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,833 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,833 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,833 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 05:02:33,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 05:02:33,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 05:02:33,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 05:02:33,835 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/recovered.edits] 2023-09-15 05:02:33,835 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/recovered.edits] 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:33,835 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:33,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-15 05:02:33,839 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf/fa088e36d1b14afe985cc6a84092cfdc to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/cf/fa088e36d1b14afe985cc6a84092cfdc 2023-09-15 05:02:33,839 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf/d1f415d7c1f24447bd3fffc614b5c0fb to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/cf/d1f415d7c1f24447bd3fffc614b5c0fb 2023-09-15 05:02:33,842 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8/recovered.edits/9.seqid 2023-09-15 05:02:33,842 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859/recovered.edits/9.seqid 2023-09-15 05:02:33,842 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/93820a2072c27f252dafee2fe6580fd8 2023-09-15 05:02:33,842 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testEmptyExportFileSystemState/31bf3a9b2b66069eb69f8c359c73f859 2023-09-15 05:02:33,842 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-15 05:02:33,843 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-15 05:02:33,843 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-15 05:02:33,846 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915d42e2459e6454817a3a4cfda3e397446 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915d42e2459e6454817a3a4cfda3e397446 2023-09-15 05:02:33,847 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915f447a13f175144258eb2e2e39e61c29a to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915f447a13f175144258eb2e2e39e61c29a 2023-09-15 05:02:33,847 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-15 05:02:33,849 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,851 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-15 05:02:33,853 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-15 05:02:33,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-15 05:02:33,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754153854"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:33,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754153854"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:33,856 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 05:02:33,856 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 93820a2072c27f252dafee2fe6580fd8, NAME => 'testtb-testEmptyExportFileSystemState,,1694754142703.93820a2072c27f252dafee2fe6580fd8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 31bf3a9b2b66069eb69f8c359c73f859, NAME => 'testtb-testEmptyExportFileSystemState,1,1694754142703.31bf3a9b2b66069eb69f8c359c73f859.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 05:02:33,856 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-15 05:02:33,856 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694754153856"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:33,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-15 05:02:33,859 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 05:02:33,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-15 05:02:33,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-15 05:02:33,937 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-15 05:02:33,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-15 05:02:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:33,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-15 05:02:33,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-15 05:02:33,973 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 759) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:36817 from appattempt_1694754061928_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:34990 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:39021 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:45092 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-250072311_1 at /127.0.0.1:34954 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-250072311_1 at /127.0.0.1:55226 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4725 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:36867 from appattempt_1694754061928_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:55240 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 216), ProcessCount=168 (was 168), AvailableMemoryMB=8220 (was 8246) 2023-09-15 05:02:33,973 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-15 05:02:33,993 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=168, AvailableMemoryMB=8219 2023-09-15 05:02:33,993 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-15 05:02:33,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 05:02:33,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:33,998 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 05:02:33,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-15 05:02:33,999 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 05:02:33,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 05:02:34,001 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,001 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,001 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e empty. 2023-09-15 05:02:34,001 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01 empty. 2023-09-15 05:02:34,002 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,002 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,002 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-15 05:02:34,011 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-15 05:02:34,012 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a7b122cabb9f9dfeea1815c1cfb9a45e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:34,012 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc466ef419f3973d592afe2e70c0ee01, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp 2023-09-15 05:02:34,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:34,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a7b122cabb9f9dfeea1815c1cfb9a45e, disabling compactions & flushes 2023-09-15 05:02:34,025 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. after waiting 0 ms 2023-09-15 05:02:34,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,025 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a7b122cabb9f9dfeea1815c1cfb9a45e: 2023-09-15 05:02:34,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:34,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing cc466ef419f3973d592afe2e70c0ee01, disabling compactions & flushes 2023-09-15 05:02:34,028 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. after waiting 0 ms 2023-09-15 05:02:34,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,028 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for cc466ef419f3973d592afe2e70c0ee01: 2023-09-15 05:02:34,030 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 05:02:34,031 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754154031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754154031"}]},"ts":"1694754154031"} 2023-09-15 05:02:34,031 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754154031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754154031"}]},"ts":"1694754154031"} 2023-09-15 05:02:34,033 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 05:02:34,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 05:02:34,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754154034"}]},"ts":"1694754154034"} 2023-09-15 05:02:34,035 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-15 05:02:34,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 05:02:34,039 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 05:02:34,039 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 05:02:34,039 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 05:02:34,039 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 05:02:34,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7b122cabb9f9dfeea1815c1cfb9a45e, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc466ef419f3973d592afe2e70c0ee01, ASSIGN}] 2023-09-15 05:02:34,042 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc466ef419f3973d592afe2e70c0ee01, ASSIGN 2023-09-15 05:02:34,042 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7b122cabb9f9dfeea1815c1cfb9a45e, ASSIGN 2023-09-15 05:02:34,043 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc466ef419f3973d592afe2e70c0ee01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35769,1694754055535; forceNewPlan=false, retain=false 2023-09-15 05:02:34,043 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7b122cabb9f9dfeea1815c1cfb9a45e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45061,1694754055570; forceNewPlan=false, retain=false 2023-09-15 05:02:34,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 05:02:34,193 INFO [jenkins-hbase4:44181] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 05:02:34,196 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=cc466ef419f3973d592afe2e70c0ee01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,196 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a7b122cabb9f9dfeea1815c1cfb9a45e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,196 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754154195"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754154195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754154195"}]},"ts":"1694754154195"} 2023-09-15 05:02:34,196 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754154195"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754154195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754154195"}]},"ts":"1694754154195"} 2023-09-15 05:02:34,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure cc466ef419f3973d592afe2e70c0ee01, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:34,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure a7b122cabb9f9dfeea1815c1cfb9a45e, server=jenkins-hbase4.apache.org,45061,1694754055570}] 2023-09-15 05:02:34,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 05:02:34,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc466ef419f3973d592afe2e70c0ee01, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 05:02:34,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7b122cabb9f9dfeea1815c1cfb9a45e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 05:02:34,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. service=AccessControlService 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. service=AccessControlService 2023-09-15 05:02:34,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:34,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,355 INFO [StoreOpener-a7b122cabb9f9dfeea1815c1cfb9a45e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,355 INFO [StoreOpener-cc466ef419f3973d592afe2e70c0ee01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,356 DEBUG [StoreOpener-a7b122cabb9f9dfeea1815c1cfb9a45e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf 2023-09-15 05:02:34,356 DEBUG [StoreOpener-cc466ef419f3973d592afe2e70c0ee01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf 2023-09-15 05:02:34,356 DEBUG [StoreOpener-a7b122cabb9f9dfeea1815c1cfb9a45e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf 2023-09-15 05:02:34,356 DEBUG [StoreOpener-cc466ef419f3973d592afe2e70c0ee01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf 2023-09-15 05:02:34,357 INFO [StoreOpener-a7b122cabb9f9dfeea1815c1cfb9a45e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7b122cabb9f9dfeea1815c1cfb9a45e columnFamilyName cf 2023-09-15 05:02:34,357 INFO [StoreOpener-cc466ef419f3973d592afe2e70c0ee01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc466ef419f3973d592afe2e70c0ee01 columnFamilyName cf 2023-09-15 05:02:34,358 INFO [StoreOpener-a7b122cabb9f9dfeea1815c1cfb9a45e-1] regionserver.HStore(310): Store=a7b122cabb9f9dfeea1815c1cfb9a45e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:34,358 INFO [StoreOpener-cc466ef419f3973d592afe2e70c0ee01-1] regionserver.HStore(310): Store=cc466ef419f3973d592afe2e70c0ee01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 05:02:34,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:34,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:34,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:34,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 05:02:34,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7b122cabb9f9dfeea1815c1cfb9a45e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66217795, jitterRate=-0.013277962803840637}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:34,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc466ef419f3973d592afe2e70c0ee01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64637706, jitterRate=-0.036823123693466187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 05:02:34,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7b122cabb9f9dfeea1815c1cfb9a45e: 2023-09-15 05:02:34,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc466ef419f3973d592afe2e70c0ee01: 2023-09-15 05:02:34,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e., pid=109, masterSystemTime=1694754154349 2023-09-15 05:02:34,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01., pid=108, masterSystemTime=1694754154349 2023-09-15 05:02:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a7b122cabb9f9dfeea1815c1cfb9a45e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754154366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754154366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754154366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754154366"}]},"ts":"1694754154366"} 2023-09-15 05:02:34,367 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=cc466ef419f3973d592afe2e70c0ee01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,367 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754154367"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694754154367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694754154367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694754154367"}]},"ts":"1694754154367"} 2023-09-15 05:02:34,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-15 05:02:34,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure a7b122cabb9f9dfeea1815c1cfb9a45e, server=jenkins-hbase4.apache.org,45061,1694754055570 in 170 msec 2023-09-15 05:02:34,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-15 05:02:34,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure cc466ef419f3973d592afe2e70c0ee01, server=jenkins-hbase4.apache.org,35769,1694754055535 in 171 msec 2023-09-15 05:02:34,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7b122cabb9f9dfeea1815c1cfb9a45e, ASSIGN in 329 msec 2023-09-15 05:02:34,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-15 05:02:34,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc466ef419f3973d592afe2e70c0ee01, ASSIGN in 330 msec 2023-09-15 05:02:34,372 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 05:02:34,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754154372"}]},"ts":"1694754154372"} 2023-09-15 05:02:34,373 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-15 05:02:34,375 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 05:02:34,375 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-15 05:02:34,376 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 05:02:34,377 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:34,377 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:34,378 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:34,378 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:34,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:34,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:34,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:34,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 05:02:34,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 384 msec 2023-09-15 05:02:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 05:02:34,603 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-15 05:02:34,605 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,606 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,607 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:02:34,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 05:02:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754154618 (current time:1694754154618). 2023-09-15 05:02:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:02:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x7f89149d to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:34,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e567af2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:34,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:34,630 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:34,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f89149d to 127.0.0.1:60709 2023-09-15 05:02:34,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:34,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x45e2b0b7 to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:34,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f8696a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:34,637 DEBUG [hconnection-0x7ff40c2d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:34,640 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:34,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:34,645 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45e2b0b7 to 127.0.0.1:60709 2023-09-15 05:02:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 05:02:34,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:02:34,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 05:02:34,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 05:02:34,650 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 05:02:34,650 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694754754650 2023-09-15 05:02:34,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 05:02:34,651 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:02:34,652 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 05:02:34,652 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:02:34,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 05:02:34,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-15 05:02:34,654 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 05:02:34,654 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694754754654 2023-09-15 05:02:34,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,667 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-15 05:02:34,667 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:34,668 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-15 05:02:34,668 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-15 05:02:34,668 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,668 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,670 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:34,670 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:34,670 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:34,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:34,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:34,670 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:34,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:34,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:34,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:34,671 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,671 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,671 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,671 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:02:34,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 05:02:34,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 05:02:34,672 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 05:02:34,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 05:02:34,672 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 05:02:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 05:02:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 05:02:34,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 05:02:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 05:02:34,675 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:34,675 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 05:02:34,676 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 05:02:34,676 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 05:02:34,676 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 05:02:34,676 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 05:02:34,676 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 05:02:34,684 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,684 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,685 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@458a7ae8[Count = 1] remaining members to acquire global barrier 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:34,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 05:02:34,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@458a7ae8[Count = 0] remaining members to acquire global barrier 2023-09-15 05:02:34,688 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-15 05:02:34,688 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,689 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,689 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,689 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,690 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 05:02:34,690 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:34,690 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,690 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. started... 2023-09-15 05:02:34,690 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:02:34,690 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,691 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc466ef419f3973d592afe2e70c0ee01: 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. started... 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7b122cabb9f9dfeea1815c1cfb9a45e: 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:34,692 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 05:02:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 05:02:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 05:02:34,707 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. completed. 2023-09-15 05:02:34,707 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,707 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:34,707 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:34,707 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,707 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 05:02:34,707 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:02:34,707 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. completed. 2023-09-15 05:02:34,707 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:34,708 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:34,708 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:34,708 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,708 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 05:02:34,708 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:02:34,709 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:34,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:34,711 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,711 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 05:02:34,711 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:34,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:34,711 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 05:02:34,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:34,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:34,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45061,1694754055570': 2023-09-15 05:02:34,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-15 05:02:34,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:34,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:34,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:34,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:34,717 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 05:02:34,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,717 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:34,717 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 05:02:34,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:02:34,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-15 05:02:34,721 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-15 05:02:34,721 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:02:34,721 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:02:34,721 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,721 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:02:34,723 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:34,723 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,724 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,723 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,723 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:34,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:34,724 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:34,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:34,725 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,727 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,727 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:34,727 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:34,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:34,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:34,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:34,731 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:34,731 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:34,731 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,730 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:34,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:34,730 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:34,731 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:34,732 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:34,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:02:34,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:34,732 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:34,734 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:34,734 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,734 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:34,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 05:02:34,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,753 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 05:02:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:02:34,754 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:02:34,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-15 05:02:34,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,769 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694754154650Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694754154746 (+96 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694754154746Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694754154747 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694754154750 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694754154762 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694754154768 (+6 ms) 2023-09-15 05:02:34,771 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 05:02:34,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 120 msec 2023-09-15 05:02:34,954 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:34,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 05:02:34,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:02:34,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45061] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:02:34,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35769] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 05:02:34,960 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:34,960 DEBUG [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:34,960 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 05:02:34,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 05:02:34,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694754154969 (current time:1694754154969). 2023-09-15 05:02:34,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 05:02:34,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x38b31a3f to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:34,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6779fc60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:34,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:34,979 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:34,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38b31a3f to 127.0.0.1:60709 2023-09-15 05:02:34,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:34,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(139): Connect 0x0c81fe3b to 127.0.0.1:60709 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 05:02:34,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cc37f76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 05:02:34,987 DEBUG [hconnection-0x4711c72-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:34,995 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:34,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 05:02:35,001 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 05:02:35,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c81fe3b to 127.0.0.1:60709 2023-09-15 05:02:35,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:02:35,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 05:02:35,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 05:02:35,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 05:02:35,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 05:02:35,006 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 05:02:35,007 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694754755007 2023-09-15 05:02:35,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 05:02:35,008 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 05:02:35,008 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 05:02:35,009 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 05:02:35,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 05:02:35,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-15 05:02:35,014 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 05:02:35,015 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694754755015 2023-09-15 05:02:35,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,027 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-15 05:02:35,027 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:35,028 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-15 05:02:35,028 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-15 05:02:35,029 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,029 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:35,032 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:35,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:35,032 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:35,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:35,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:35,032 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:35,032 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,032 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,033 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,033 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 05:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,034 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 05:02:35,034 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:35,033 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:35,034 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 05:02:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 05:02:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 05:02:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 05:02:35,035 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 05:02:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 05:02:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 05:02:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 05:02:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36615,1694754055486' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 05:02:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 05:02:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 05:02:35,039 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,039 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,039 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:35,040 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:35,040 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,040 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:35,040 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,040 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,040 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:35,040 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,040 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 05:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35769,1694754055535' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7daa03dd[Count = 1] remaining members to acquire global barrier 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:35,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45061,1694754055570' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 05:02:35,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7daa03dd[Count = 0] remaining members to acquire global barrier 2023-09-15 05:02:35,044 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-15 05:02:35,044 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,048 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,048 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,048 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,048 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 05:02:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,049 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:35,049 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:35,049 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36615,1694754055486' in zk 2023-09-15 05:02:35,049 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:35,049 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 05:02:35,049 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. started... 2023-09-15 05:02:35,049 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. started... 2023-09-15 05:02:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 05:02:35,049 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7b122cabb9f9dfeea1815c1cfb9a45e 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-15 05:02:35,049 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc466ef419f3973d592afe2e70c0ee01 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-15 05:02:35,051 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 05:02:35,051 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:35,051 DEBUG [member: 'jenkins-hbase4.apache.org,36615,1694754055486' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 05:02:35,066 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915c00c63c5f9ac4487944948ed4f73c39c to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230915c00c63c5f9ac4487944948ed4f73c39c 2023-09-15 05:02:35,067 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309157ed525394e7241ee8bc01910cdc90c6e to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309157ed525394e7241ee8bc01910cdc90c6e 2023-09-15 05:02:35,073 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/.tmp/cf/c4d0a2e614cd4dd4828aac99dfc1df67 2023-09-15 05:02:35,073 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/.tmp/cf/cb601dbe24434956965989c8014c8463 2023-09-15 05:02:35,077 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/.tmp/cf/c4d0a2e614cd4dd4828aac99dfc1df67 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf/c4d0a2e614cd4dd4828aac99dfc1df67 2023-09-15 05:02:35,078 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/.tmp/cf/cb601dbe24434956965989c8014c8463 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf/cb601dbe24434956965989c8014c8463 2023-09-15 05:02:35,081 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf/c4d0a2e614cd4dd4828aac99dfc1df67, entries=3, sequenceid=6, filesize=5.4 K 2023-09-15 05:02:35,084 INFO [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a7b122cabb9f9dfeea1815c1cfb9a45e in 35ms, sequenceid=6, compaction requested=false 2023-09-15 05:02:35,084 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf/cb601dbe24434956965989c8014c8463, entries=47, sequenceid=6, filesize=13.4 K 2023-09-15 05:02:35,084 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-15 05:02:35,084 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7b122cabb9f9dfeea1815c1cfb9a45e: 2023-09-15 05:02:35,084 INFO [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for cc466ef419f3973d592afe2e70c0ee01 in 35ms, sequenceid=6, compaction requested=false 2023-09-15 05:02:35,085 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc466ef419f3973d592afe2e70c0ee01: 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf/c4d0a2e614cd4dd4828aac99dfc1df67] hfiles 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf/c4d0a2e614cd4dd4828aac99dfc1df67 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf/cb601dbe24434956965989c8014c8463] hfiles 2023-09-15 05:02:35,086 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf/cb601dbe24434956965989c8014c8463 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,092 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. completed. 2023-09-15 05:02:35,093 DEBUG [rs(jenkins-hbase4.apache.org,45061,1694754055570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:35,093 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:35,093 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:35,093 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,093 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 05:02:35,093 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45061,1694754055570' in zk 2023-09-15 05:02:35,094 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,094 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 05:02:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:35,094 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:35,094 DEBUG [member: 'jenkins-hbase4.apache.org,45061,1694754055570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 05:02:35,096 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. completed. 2023-09-15 05:02:35,096 DEBUG [rs(jenkins-hbase4.apache.org,35769,1694754055535)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:35,096 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 05:02:35,096 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 05:02:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:35,096 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,096 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 05:02:35,096 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35769,1694754055535' in zk 2023-09-15 05:02:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,098 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,098 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 05:02:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,098 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:35,098 DEBUG [member: 'jenkins-hbase4.apache.org,35769,1694754055535' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 05:02:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45061,1694754055570': 2023-09-15 05:02:35,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45061,1694754055570' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-15 05:02:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35769,1694754055535': 2023-09-15 05:02:35,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35769,1694754055535' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-15 05:02:35,104 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-15 05:02:35,104 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 05:02:35,104 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 05:02:35,104 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,104 INFO [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 05:02:35,107 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:35,107 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 05:02:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 05:02:35,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,107 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,108 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 05:02:35,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:35,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:35,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:35,108 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,108 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 05:02:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,109 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 05:02:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-15 05:02:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,110 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 05:02:35,110 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 05:02:35,111 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,111 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,113 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,113 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:35,113 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:35,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:35,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:35,113 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,113 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:35,113 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,113 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 05:02:35,114 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,114 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:35,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:35,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,113 DEBUG [(jenkins-hbase4.apache.org,44181,1694754054269)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 05:02:35,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 05:02:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:35,113 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 05:02:35,114 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 05:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 05:02:35,116 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:35,116 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:35,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:35,116 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 05:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 05:02:35,116 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:02:35,116 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:35,116 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,116 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309157ed525394e7241ee8bc01910cdc90c6e, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230915c00c63c5f9ac4487944948ed4f73c39c] mob files 2023-09-15 05:02:35,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309157ed525394e7241ee8bc01910cdc90c6e 2023-09-15 05:02:35,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230915c00c63c5f9ac4487944948ed4f73c39c 2023-09-15 05:02:35,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-15 05:02:35,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,153 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694754155007Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694754155123 (+116 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694754155123Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694754155123Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694754155130 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694754155145 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694754155152 (+7 ms) 2023-09-15 05:02:35,155 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 05:02:35,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 147 msec 2023-09-15 05:02:35,310 DEBUG [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 05:02:35,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 05:02:35,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 05:02:35,312 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312 2023-09-15 05:02:35,312 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41743, tgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312, rawTgtDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312, srcFsUri=hdfs://localhost:41743, srcDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:02:35,334 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78 2023-09-15 05:02:35,334 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1602900806_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,334 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41743, inputRoot=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78, snapshotDir=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-15 05:02:35,345 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:35,360 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:35,361 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:35,361 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:35,361 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,234 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-6392081614441722502.jar 2023-09-15 05:02:36,234 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,234 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,301 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/hadoop-4461068245891877202.jar 2023-09-15 05:02:36,301 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,301 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,302 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,302 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,303 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,303 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 05:02:36,303 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 05:02:36,304 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 05:02:36,304 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 05:02:36,304 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 05:02:36,304 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 05:02:36,305 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 05:02:36,305 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 05:02:36,306 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 05:02:36,306 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 05:02:36,306 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 05:02:36,307 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:36,307 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:36,308 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:36,308 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:36,308 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 05:02:36,309 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:36,309 DEBUG [Listener at jenkins-hbase4.apache.org/33501] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 05:02:36,631 WARN [Listener at jenkins-hbase4.apache.org/33501] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 05:02:36,633 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-15 05:02:36,635 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-15 05:02:37,993 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:02:37,993 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 05:02:38,000 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0006_000001 (auth:SIMPLE) 2023-09-15 05:02:38,173 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0007_000001 (auth:SIMPLE) 2023-09-15 05:02:39,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:02:41,835 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0007_000001 (auth:SIMPLE) 2023-09-15 05:02:44,045 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0007_000001 (auth:SIMPLE) 2023-09-15 05:02:47,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694754061928_0007_000001 (auth:SIMPLE) 2023-09-15 05:02:48,815 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 05:02:48,816 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 05:02:48,826 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:48,826 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 05:02:48,827 INFO [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 05:02:48,827 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:48,827 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-15 05:02:48,827 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-15 05:02:48,827 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_427865204_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:48,828 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-15 05:02:48,828 DEBUG [Listener at jenkins-hbase4.apache.org/33501] snapshot.TestExportSnapshot(367): hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/export-test/export-1694754155312/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-15 05:02:48,833 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:48,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:48,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:48,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 05:02:48,837 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754168837"}]},"ts":"1694754168837"} 2023-09-15 05:02:48,838 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-15 05:02:48,839 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-15 05:02:48,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7b122cabb9f9dfeea1815c1cfb9a45e, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc466ef419f3973d592afe2e70c0ee01, UNASSIGN}] 2023-09-15 05:02:48,841 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7b122cabb9f9dfeea1815c1cfb9a45e, UNASSIGN 2023-09-15 05:02:48,842 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc466ef419f3973d592afe2e70c0ee01, UNASSIGN 2023-09-15 05:02:48,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a7b122cabb9f9dfeea1815c1cfb9a45e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:02:48,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=cc466ef419f3973d592afe2e70c0ee01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:02:48,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754168842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754168842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754168842"}]},"ts":"1694754168842"} 2023-09-15 05:02:48,842 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754168842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694754168842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694754168842"}]},"ts":"1694754168842"} 2023-09-15 05:02:48,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure a7b122cabb9f9dfeea1815c1cfb9a45e, server=jenkins-hbase4.apache.org,45061,1694754055570}] 2023-09-15 05:02:48,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure cc466ef419f3973d592afe2e70c0ee01, server=jenkins-hbase4.apache.org,35769,1694754055535}] 2023-09-15 05:02:48,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 05:02:48,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:48,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:48,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7b122cabb9f9dfeea1815c1cfb9a45e, disabling compactions & flushes 2023-09-15 05:02:48,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc466ef419f3973d592afe2e70c0ee01, disabling compactions & flushes 2023-09-15 05:02:48,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:48,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:48,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:48,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. after waiting 0 ms 2023-09-15 05:02:48,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:48,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:48,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. after waiting 0 ms 2023-09-15 05:02:48,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:49,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:49,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:02:49,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:49,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:02:49,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e. 2023-09-15 05:02:49,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01. 2023-09-15 05:02:49,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7b122cabb9f9dfeea1815c1cfb9a45e: 2023-09-15 05:02:49,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc466ef419f3973d592afe2e70c0ee01: 2023-09-15 05:02:49,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:49,013 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=cc466ef419f3973d592afe2e70c0ee01, regionState=CLOSED 2023-09-15 05:02:49,013 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754169013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754169013"}]},"ts":"1694754169013"} 2023-09-15 05:02:49,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:49,014 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a7b122cabb9f9dfeea1815c1cfb9a45e, regionState=CLOSED 2023-09-15 05:02:49,014 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694754169013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694754169013"}]},"ts":"1694754169013"} 2023-09-15 05:02:49,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-15 05:02:49,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure cc466ef419f3973d592afe2e70c0ee01, server=jenkins-hbase4.apache.org,35769,1694754055535 in 170 msec 2023-09-15 05:02:49,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-15 05:02:49,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure a7b122cabb9f9dfeea1815c1cfb9a45e, server=jenkins-hbase4.apache.org,45061,1694754055570 in 172 msec 2023-09-15 05:02:49,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc466ef419f3973d592afe2e70c0ee01, UNASSIGN in 176 msec 2023-09-15 05:02:49,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-15 05:02:49,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7b122cabb9f9dfeea1815c1cfb9a45e, UNASSIGN in 176 msec 2023-09-15 05:02:49,018 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694754169018"}]},"ts":"1694754169018"} 2023-09-15 05:02:49,019 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-15 05:02:49,020 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-15 05:02:49,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-09-15 05:02:49,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 05:02:49,139 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-15 05:02:49,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,142 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,143 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,144 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35769] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,146 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:49,146 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:49,147 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,147 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,147 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,147 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 05:02:49,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 05:02:49,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 05:02:49,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 05:02:49,149 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/recovered.edits] 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:49,149 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf, FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/recovered.edits] 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,149 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 05:02:49,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-15 05:02:49,153 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf/c4d0a2e614cd4dd4828aac99dfc1df67 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/cf/c4d0a2e614cd4dd4828aac99dfc1df67 2023-09-15 05:02:49,153 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf/cb601dbe24434956965989c8014c8463 to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/cf/cb601dbe24434956965989c8014c8463 2023-09-15 05:02:49,156 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e/recovered.edits/9.seqid 2023-09-15 05:02:49,156 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/recovered.edits/9.seqid to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01/recovered.edits/9.seqid 2023-09-15 05:02:49,156 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7b122cabb9f9dfeea1815c1cfb9a45e 2023-09-15 05:02:49,156 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc466ef419f3973d592afe2e70c0ee01 2023-09-15 05:02:49,156 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-15 05:02:49,157 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-15 05:02:49,158 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-15 05:02:49,161 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309157ed525394e7241ee8bc01910cdc90c6e to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309157ed525394e7241ee8bc01910cdc90c6e 2023-09-15 05:02:49,162 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230915c00c63c5f9ac4487944948ed4f73c39c to hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230915c00c63c5f9ac4487944948ed4f73c39c 2023-09-15 05:02:49,162 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-15 05:02:49,164 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,166 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-15 05:02:49,167 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-15 05:02:49,168 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,168 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-15 05:02:49,168 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754169168"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:49,168 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694754169168"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:49,170 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 05:02:49,170 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a7b122cabb9f9dfeea1815c1cfb9a45e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694754153995.a7b122cabb9f9dfeea1815c1cfb9a45e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc466ef419f3973d592afe2e70c0ee01, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694754153995.cc466ef419f3973d592afe2e70c0ee01.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 05:02:49,170 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-15 05:02:49,170 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694754169170"}]},"ts":"9223372036854775807"} 2023-09-15 05:02:49,171 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-15 05:02:49,173 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-15 05:02:49,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-15 05:02:49,251 INFO [Listener at jenkins-hbase4.apache.org/33501] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-15 05:02:49,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-15 05:02:49,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-15 05:02:49,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44181] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 05:02:49,284 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=768 (was 767) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_657013153_1 at /127.0.0.1:60698 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:60740 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:42893 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_657013153_1 at /127.0.0.1:49414 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:49840 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5329 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_427865204_17 at /127.0.0.1:49426 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9e64fc8-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=159 (was 204), ProcessCount=168 (was 168), AvailableMemoryMB=8107 (was 8219) 2023-09-15 05:02:49,285 WARN [Listener at jenkins-hbase4.apache.org/33501] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-15 05:02:49,285 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-15 05:02:49,294 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 05:02:49,405 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694754061928_0007_01_000001 is : 143 2023-09-15 05:02:54,578 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 05:03:03,420 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 05:03:17,536 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 05:03:17,537 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 05:03:17,647 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-15 05:03:17,654 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-15 05:03:17,655 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 05:03:17,664 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 05:03:17,767 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 05:03:17,767 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-15 05:03:17,767 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-15 05:03:17,768 INFO [Listener at jenkins-hbase4.apache.org/33501] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-15 05:03:17,768 DEBUG [Listener at jenkins-hbase4.apache.org/33501] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3f5cbd to 127.0.0.1:60709 2023-09-15 05:03:17,768 DEBUG [Listener at jenkins-hbase4.apache.org/33501] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:17,768 DEBUG [Listener at jenkins-hbase4.apache.org/33501] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-15 05:03:17,768 DEBUG [Listener at jenkins-hbase4.apache.org/33501] util.JVMClusterUtil(257): Found active master hash=775040334, stopped=false 2023-09-15 05:03:17,768 DEBUG [Listener at jenkins-hbase4.apache.org/33501] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:03:17,768 DEBUG [Listener at jenkins-hbase4.apache.org/33501] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-15 05:03:17,769 INFO [Listener at jenkins-hbase4.apache.org/33501] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:03:17,770 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 05:03:17,770 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 05:03:17,770 INFO [Listener at jenkins-hbase4.apache.org/33501] procedure2.ProcedureExecutor(628): Stopping 2023-09-15 05:03:17,770 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:03:17,770 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 05:03:17,770 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 05:03:17,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:03:17,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:03:17,770 DEBUG [Listener at jenkins-hbase4.apache.org/33501] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e4b2947 to 127.0.0.1:60709 2023-09-15 05:03:17,771 DEBUG [Listener at jenkins-hbase4.apache.org/33501] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:17,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:03:17,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 05:03:17,771 INFO [Listener at jenkins-hbase4.apache.org/33501] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36615,1694754055486' ***** 2023-09-15 05:03:17,771 DEBUG [Listener at jenkins-hbase4.apache.org/33501] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:03:17,771 INFO [Listener at jenkins-hbase4.apache.org/33501] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 05:03:17,771 INFO [Listener at jenkins-hbase4.apache.org/33501] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35769,1694754055535' ***** 2023-09-15 05:03:17,771 DEBUG [Listener at jenkins-hbase4.apache.org/33501] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:03:17,771 INFO [Listener at jenkins-hbase4.apache.org/33501] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 05:03:17,771 INFO [Listener at jenkins-hbase4.apache.org/33501] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45061,1694754055570' ***** 2023-09-15 05:03:17,771 INFO [RS:0;jenkins-hbase4:36615] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 05:03:17,772 INFO [RS:1;jenkins-hbase4:35769] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 05:03:17,771 DEBUG [Listener at jenkins-hbase4.apache.org/33501] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:03:17,772 INFO [Listener at jenkins-hbase4.apache.org/33501] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 05:03:17,772 INFO [RS:1;jenkins-hbase4:35769] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 05:03:17,772 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 05:03:17,772 INFO [RS:1;jenkins-hbase4:35769] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 05:03:17,772 INFO [RS:0;jenkins-hbase4:36615] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 05:03:17,772 INFO [RS:0;jenkins-hbase4:36615] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 05:03:17,772 INFO [RS:2;jenkins-hbase4:45061] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 05:03:17,772 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 05:03:17,772 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 05:03:17,772 INFO [RS:2;jenkins-hbase4:45061] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 05:03:17,772 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(3305): Received CLOSE for 366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:03:17,772 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:03:17,772 INFO [RS:2;jenkins-hbase4:45061] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 05:03:17,772 DEBUG [RS:0;jenkins-hbase4:36615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d0215c5 to 127.0.0.1:60709 2023-09-15 05:03:17,772 DEBUG [RS:0;jenkins-hbase4:36615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:17,772 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(3305): Received CLOSE for 22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:03:17,775 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:03:17,775 INFO [RS:0;jenkins-hbase4:36615] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 05:03:17,775 INFO [RS:0;jenkins-hbase4:36615] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 05:03:17,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 22649dbbdac5f57ee64ba73f5616a37d, disabling compactions & flushes 2023-09-15 05:03:17,775 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:03:17,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:03:17,776 DEBUG [RS:1;jenkins-hbase4:35769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1df79314 to 127.0.0.1:60709 2023-09-15 05:03:17,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 366fac7bd8b2048c34f7bba0d8da5df6, disabling compactions & flushes 2023-09-15 05:03:17,775 INFO [RS:0;jenkins-hbase4:36615] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 05:03:17,775 DEBUG [RS:2;jenkins-hbase4:45061] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29f220cb to 127.0.0.1:60709 2023-09-15 05:03:17,776 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-15 05:03:17,776 DEBUG [RS:2;jenkins-hbase4:45061] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:17,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:03:17,777 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-15 05:03:17,776 DEBUG [RS:1;jenkins-hbase4:35769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:17,777 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-15 05:03:17,777 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-15 05:03:17,777 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-15 05:03:17,777 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1478): Online Regions={366fac7bd8b2048c34f7bba0d8da5df6=hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6.} 2023-09-15 05:03:17,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-15 05:03:17,777 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1478): Online Regions={22649dbbdac5f57ee64ba73f5616a37d=hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d.} 2023-09-15 05:03:17,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-15 05:03:17,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. after waiting 0 ms 2023-09-15 05:03:17,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. after waiting 0 ms 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:03:17,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:03:17,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 22649dbbdac5f57ee64ba73f5616a37d 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-15 05:03:17,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 366fac7bd8b2048c34f7bba0d8da5df6 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-15 05:03:17,778 DEBUG [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1504): Waiting on 22649dbbdac5f57ee64ba73f5616a37d 2023-09-15 05:03:17,778 DEBUG [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1504): Waiting on 366fac7bd8b2048c34f7bba0d8da5df6 2023-09-15 05:03:17,778 DEBUG [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-15 05:03:17,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/.tmp/l/583fe8966b594cc9ac9a3ea870395a79 2023-09-15 05:03:17,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/.tmp/info/cafd5fe89e314a649c4bb8b74b90ded4 2023-09-15 05:03:17,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/.tmp/info/757efaa8be2d439a81242eb6b9518173 2023-09-15 05:03:17,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 583fe8966b594cc9ac9a3ea870395a79 2023-09-15 05:03:17,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/.tmp/l/583fe8966b594cc9ac9a3ea870395a79 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/l/583fe8966b594cc9ac9a3ea870395a79 2023-09-15 05:03:17,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/.tmp/info/757efaa8be2d439a81242eb6b9518173 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/info/757efaa8be2d439a81242eb6b9518173 2023-09-15 05:03:17,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cafd5fe89e314a649c4bb8b74b90ded4 2023-09-15 05:03:17,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 583fe8966b594cc9ac9a3ea870395a79 2023-09-15 05:03:17,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/l/583fe8966b594cc9ac9a3ea870395a79, entries=7, sequenceid=18, filesize=5.2 K 2023-09-15 05:03:17,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 366fac7bd8b2048c34f7bba0d8da5df6 in 42ms, sequenceid=18, compaction requested=false 2023-09-15 05:03:17,821 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 05:03:17,821 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 05:03:17,821 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 05:03:17,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/info/757efaa8be2d439a81242eb6b9518173, entries=2, sequenceid=6, filesize=4.8 K 2023-09-15 05:03:17,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 22649dbbdac5f57ee64ba73f5616a37d in 50ms, sequenceid=6, compaction requested=false 2023-09-15 05:03:17,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/acl/366fac7bd8b2048c34f7bba0d8da5df6/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-15 05:03:17,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:03:17,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:03:17,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 366fac7bd8b2048c34f7bba0d8da5df6: 2023-09-15 05:03:17,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694754058493.366fac7bd8b2048c34f7bba0d8da5df6. 2023-09-15 05:03:17,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/.tmp/rep_barrier/1799a3cf8a474a329e17971b3e0c9d2f 2023-09-15 05:03:17,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/namespace/22649dbbdac5f57ee64ba73f5616a37d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 05:03:17,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:03:17,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:03:17,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 22649dbbdac5f57ee64ba73f5616a37d: 2023-09-15 05:03:17,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694754057754.22649dbbdac5f57ee64ba73f5616a37d. 2023-09-15 05:03:17,847 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1799a3cf8a474a329e17971b3e0c9d2f 2023-09-15 05:03:17,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/.tmp/table/6291238513dd4f1b9067ec5ead760e13 2023-09-15 05:03:17,865 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6291238513dd4f1b9067ec5ead760e13 2023-09-15 05:03:17,866 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/.tmp/info/cafd5fe89e314a649c4bb8b74b90ded4 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/info/cafd5fe89e314a649c4bb8b74b90ded4 2023-09-15 05:03:17,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cafd5fe89e314a649c4bb8b74b90ded4 2023-09-15 05:03:17,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/info/cafd5fe89e314a649c4bb8b74b90ded4, entries=48, sequenceid=131, filesize=10.3 K 2023-09-15 05:03:17,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/.tmp/rep_barrier/1799a3cf8a474a329e17971b3e0c9d2f as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/rep_barrier/1799a3cf8a474a329e17971b3e0c9d2f 2023-09-15 05:03:17,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1799a3cf8a474a329e17971b3e0c9d2f 2023-09-15 05:03:17,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/rep_barrier/1799a3cf8a474a329e17971b3e0c9d2f, entries=13, sequenceid=131, filesize=6.4 K 2023-09-15 05:03:17,876 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/.tmp/table/6291238513dd4f1b9067ec5ead760e13 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/table/6291238513dd4f1b9067ec5ead760e13 2023-09-15 05:03:17,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6291238513dd4f1b9067ec5ead760e13 2023-09-15 05:03:17,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/table/6291238513dd4f1b9067ec5ead760e13, entries=24, sequenceid=131, filesize=6.9 K 2023-09-15 05:03:17,881 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 103ms, sequenceid=131, compaction requested=false 2023-09-15 05:03:17,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-15 05:03:17,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 05:03:17,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-15 05:03:17,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-15 05:03:17,893 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-15 05:03:17,893 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-15 05:03:17,942 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-15 05:03:17,942 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-15 05:03:17,979 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45061,1694754055570; all regions closed. 2023-09-15 05:03:17,979 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35769,1694754055535; all regions closed. 2023-09-15 05:03:17,979 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36615,1694754055486; all regions closed. 2023-09-15 05:03:17,982 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-15 05:03:17,982 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-15 05:03:17,993 DEBUG [RS:1;jenkins-hbase4:35769] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs 2023-09-15 05:03:17,993 INFO [RS:1;jenkins-hbase4:35769] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35769%2C1694754055535:(num 1694754057128) 2023-09-15 05:03:17,993 DEBUG [RS:1;jenkins-hbase4:35769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:17,993 DEBUG [RS:0;jenkins-hbase4:36615] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs 2023-09-15 05:03:17,993 INFO [RS:1;jenkins-hbase4:35769] regionserver.LeaseManager(133): Closed leases 2023-09-15 05:03:17,993 DEBUG [RS:2;jenkins-hbase4:45061] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs 2023-09-15 05:03:17,993 INFO [RS:0;jenkins-hbase4:36615] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36615%2C1694754055486.meta:.meta(num 1694754057408) 2023-09-15 05:03:17,993 INFO [RS:2;jenkins-hbase4:45061] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45061%2C1694754055570:(num 1694754057128) 2023-09-15 05:03:17,993 DEBUG [RS:2;jenkins-hbase4:45061] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:17,993 INFO [RS:1;jenkins-hbase4:35769] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-15 05:03:17,993 INFO [RS:2;jenkins-hbase4:45061] regionserver.LeaseManager(133): Closed leases 2023-09-15 05:03:17,993 INFO [RS:1;jenkins-hbase4:35769] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 05:03:17,994 INFO [RS:1;jenkins-hbase4:35769] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 05:03:17,994 INFO [RS:2;jenkins-hbase4:45061] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-15 05:03:17,993 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 05:03:17,994 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 05:03:17,994 INFO [RS:2;jenkins-hbase4:45061] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 05:03:17,994 INFO [RS:1;jenkins-hbase4:35769] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 05:03:17,995 INFO [RS:2;jenkins-hbase4:45061] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 05:03:17,995 INFO [RS:2;jenkins-hbase4:45061] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 05:03:17,996 INFO [RS:2;jenkins-hbase4:45061] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45061 2023-09-15 05:03:17,997 INFO [RS:1;jenkins-hbase4:35769] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35769 2023-09-15 05:03:18,002 DEBUG [RS:0;jenkins-hbase4:36615] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/oldWALs 2023-09-15 05:03:18,002 INFO [RS:0;jenkins-hbase4:36615] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36615%2C1694754055486:(num 1694754057128) 2023-09-15 05:03:18,002 DEBUG [RS:0;jenkins-hbase4:36615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:18,002 INFO [RS:0;jenkins-hbase4:36615] regionserver.LeaseManager(133): Closed leases 2023-09-15 05:03:18,002 INFO [RS:0;jenkins-hbase4:36615] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-15 05:03:18,002 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 05:03:18,003 INFO [RS:0;jenkins-hbase4:36615] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36615 2023-09-15 05:03:18,006 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45061,1694754055570 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36615,1694754055486 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:03:18,007 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35769,1694754055535 2023-09-15 05:03:18,008 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45061,1694754055570] 2023-09-15 05:03:18,009 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45061,1694754055570; numProcessing=1 2023-09-15 05:03:18,016 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45061,1694754055570 already deleted, retry=false 2023-09-15 05:03:18,016 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45061,1694754055570 expired; onlineServers=2 2023-09-15 05:03:18,016 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35769,1694754055535] 2023-09-15 05:03:18,016 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35769,1694754055535; numProcessing=2 2023-09-15 05:03:18,017 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35769,1694754055535 already deleted, retry=false 2023-09-15 05:03:18,017 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35769,1694754055535 expired; onlineServers=1 2023-09-15 05:03:18,017 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36615,1694754055486] 2023-09-15 05:03:18,017 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36615,1694754055486; numProcessing=3 2023-09-15 05:03:18,018 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36615,1694754055486 already deleted, retry=false 2023-09-15 05:03:18,018 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36615,1694754055486 expired; onlineServers=0 2023-09-15 05:03:18,018 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44181,1694754054269' ***** 2023-09-15 05:03:18,018 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-15 05:03:18,018 DEBUG [M:0;jenkins-hbase4:44181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f0f2775, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 05:03:18,018 INFO [M:0;jenkins-hbase4:44181] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44181,1694754054269 2023-09-15 05:03:18,018 INFO [M:0;jenkins-hbase4:44181] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44181,1694754054269; all regions closed. 2023-09-15 05:03:18,019 DEBUG [M:0;jenkins-hbase4:44181] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 05:03:18,019 DEBUG [M:0;jenkins-hbase4:44181] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-15 05:03:18,019 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-15 05:03:18,019 DEBUG [M:0;jenkins-hbase4:44181] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-15 05:03:18,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694754056792] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694754056792,5,FailOnTimeoutGroup] 2023-09-15 05:03:18,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694754056792] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694754056792,5,FailOnTimeoutGroup] 2023-09-15 05:03:18,019 INFO [M:0;jenkins-hbase4:44181] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-15 05:03:18,019 INFO [M:0;jenkins-hbase4:44181] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-15 05:03:18,019 INFO [M:0;jenkins-hbase4:44181] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-15 05:03:18,019 DEBUG [M:0;jenkins-hbase4:44181] master.HMaster(1512): Stopping service threads 2023-09-15 05:03:18,019 INFO [M:0;jenkins-hbase4:44181] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-15 05:03:18,019 ERROR [M:0;jenkins-hbase4:44181] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-09-15 05:03:18,019 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-15 05:03:18,020 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 05:03:18,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 05:03:18,020 INFO [M:0;jenkins-hbase4:44181] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-15 05:03:18,020 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-15 05:03:18,020 DEBUG [M:0;jenkins-hbase4:44181] zookeeper.ZKUtil(398): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-15 05:03:18,020 WARN [M:0;jenkins-hbase4:44181] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-15 05:03:18,020 INFO [M:0;jenkins-hbase4:44181] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-15 05:03:18,021 INFO [M:0;jenkins-hbase4:44181] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-15 05:03:18,021 DEBUG [M:0;jenkins-hbase4:44181] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-15 05:03:18,021 INFO [M:0;jenkins-hbase4:44181] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:03:18,021 DEBUG [M:0;jenkins-hbase4:44181] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:03:18,021 DEBUG [M:0;jenkins-hbase4:44181] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-15 05:03:18,021 DEBUG [M:0;jenkins-hbase4:44181] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:03:18,021 INFO [M:0;jenkins-hbase4:44181] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.17 KB 2023-09-15 05:03:18,038 INFO [M:0;jenkins-hbase4:44181] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/960e0aed1d094ad68173552474254075 2023-09-15 05:03:18,042 INFO [M:0;jenkins-hbase4:44181] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 960e0aed1d094ad68173552474254075 2023-09-15 05:03:18,043 DEBUG [M:0;jenkins-hbase4:44181] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/960e0aed1d094ad68173552474254075 as hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/960e0aed1d094ad68173552474254075 2023-09-15 05:03:18,047 INFO [M:0;jenkins-hbase4:44181] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 960e0aed1d094ad68173552474254075 2023-09-15 05:03:18,047 INFO [M:0;jenkins-hbase4:44181] regionserver.HStore(1080): Added hdfs://localhost:41743/user/jenkins/test-data/3107ec2c-d292-d2ad-ee7d-3720fb136e78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/960e0aed1d094ad68173552474254075, entries=119, sequenceid=899, filesize=28.7 K 2023-09-15 05:03:18,048 INFO [M:0;jenkins-hbase4:44181] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384910, heapSize ~452.16 KB/463008, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-09-15 05:03:18,050 INFO [M:0;jenkins-hbase4:44181] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 05:03:18,050 DEBUG [M:0;jenkins-hbase4:44181] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 05:03:18,053 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 05:03:18,053 INFO [M:0;jenkins-hbase4:44181] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-15 05:03:18,054 INFO [M:0;jenkins-hbase4:44181] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44181 2023-09-15 05:03:18,056 DEBUG [M:0;jenkins-hbase4:44181] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44181,1694754054269 already deleted, retry=false 2023-09-15 05:03:18,109 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,109 INFO [RS:2;jenkins-hbase4:45061] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45061,1694754055570; zookeeper connection closed. 2023-09-15 05:03:18,109 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:45061-0x100adf5d4710003, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,109 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@537f373] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@537f373 2023-09-15 05:03:18,209 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,209 INFO [M:0;jenkins-hbase4:44181] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44181,1694754054269; zookeeper connection closed. 2023-09-15 05:03:18,209 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): master:44181-0x100adf5d4710000, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,309 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,309 INFO [RS:1;jenkins-hbase4:35769] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35769,1694754055535; zookeeper connection closed. 2023-09-15 05:03:18,309 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:35769-0x100adf5d4710002, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,310 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@59f91a45] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@59f91a45 2023-09-15 05:03:18,409 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,409 INFO [RS:0;jenkins-hbase4:36615] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36615,1694754055486; zookeeper connection closed. 2023-09-15 05:03:18,409 DEBUG [Listener at localhost/44249-EventThread] zookeeper.ZKWatcher(600): regionserver:36615-0x100adf5d4710001, quorum=127.0.0.1:60709, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 05:03:18,410 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f6d05bf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f6d05bf 2023-09-15 05:03:18,410 INFO [Listener at jenkins-hbase4.apache.org/33501] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-15 05:03:18,410 WARN [Listener at jenkins-hbase4.apache.org/33501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 05:03:18,413 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 05:03:18,516 WARN [BP-1611635098-172.31.14.131-1694754050539 heartbeating to localhost/127.0.0.1:41743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 05:03:18,516 WARN [BP-1611635098-172.31.14.131-1694754050539 heartbeating to localhost/127.0.0.1:41743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1611635098-172.31.14.131-1694754050539 (Datanode Uuid 818af21e-01e8-4318-bb07-1dcb1e5e3240) service to localhost/127.0.0.1:41743 2023-09-15 05:03:18,519 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data5/current/BP-1611635098-172.31.14.131-1694754050539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 05:03:18,519 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data6/current/BP-1611635098-172.31.14.131-1694754050539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 05:03:18,520 WARN [Listener at jenkins-hbase4.apache.org/33501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 05:03:18,522 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 05:03:18,625 WARN [BP-1611635098-172.31.14.131-1694754050539 heartbeating to localhost/127.0.0.1:41743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 05:03:18,625 WARN [BP-1611635098-172.31.14.131-1694754050539 heartbeating to localhost/127.0.0.1:41743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1611635098-172.31.14.131-1694754050539 (Datanode Uuid cc8b44d1-9bc0-4abf-ad2e-c763ae414b4d) service to localhost/127.0.0.1:41743 2023-09-15 05:03:18,626 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data3/current/BP-1611635098-172.31.14.131-1694754050539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 05:03:18,626 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data4/current/BP-1611635098-172.31.14.131-1694754050539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 05:03:18,627 WARN [Listener at jenkins-hbase4.apache.org/33501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 05:03:18,629 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 05:03:18,732 WARN [BP-1611635098-172.31.14.131-1694754050539 heartbeating to localhost/127.0.0.1:41743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 05:03:18,732 WARN [BP-1611635098-172.31.14.131-1694754050539 heartbeating to localhost/127.0.0.1:41743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1611635098-172.31.14.131-1694754050539 (Datanode Uuid 0ae8d1fb-e68f-4079-9e7f-a2928f69005b) service to localhost/127.0.0.1:41743 2023-09-15 05:03:18,732 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data1/current/BP-1611635098-172.31.14.131-1694754050539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 05:03:18,733 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a75a5950-2d3d-e0d2-1a76-c6c7fd3ca0ff/cluster_cfe66a40-bf68-ab04-9af5-6c4030dea9ab/dfs/data/data2/current/BP-1611635098-172.31.14.131-1694754050539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 05:03:18,753 INFO [Listener at jenkins-hbase4.apache.org/33501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 05:03:18,879 INFO [Listener at jenkins-hbase4.apache.org/33501] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-15 05:03:18,974 INFO [Listener at jenkins-hbase4.apache.org/33501] hbase.HBaseTestingUtility(1293): Minicluster is down