2023-09-29 17:01:07,000 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-29 17:01:07,234 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd 2023-09-29 17:01:07,235 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-29 17:01:07,235 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-29 17:01:07,279 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-29 17:01:07,523 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-29 17:01:07,524 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad, deleteOnExit=true 2023-09-29 17:01:07,524 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-29 17:01:07,525 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/test.cache.data in system properties and HBase conf 2023-09-29 17:01:07,525 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop.tmp.dir in system properties and HBase conf 2023-09-29 17:01:07,525 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop.log.dir in system properties and HBase conf 2023-09-29 17:01:07,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-29 17:01:07,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-29 17:01:07,526 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-29 17:01:07,855 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-29 17:01:07,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-29 17:01:07,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-29 17:01:07,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-29 17:01:07,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 17:01:07,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-29 17:01:07,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-29 17:01:07,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 17:01:07,863 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 17:01:07,863 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-29 17:01:07,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/nfs.dump.dir in system properties and HBase conf 2023-09-29 17:01:07,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir in system properties and HBase conf 2023-09-29 17:01:07,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 17:01:07,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-29 17:01:07,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-29 17:01:08,395 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-29 17:01:08,400 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-29 17:01:08,723 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-29 17:01:08,898 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-29 17:01:08,913 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:08,955 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:08,991 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_localhost_41455_hdfs____.osu9en/webapp 2023-09-29 17:01:09,146 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41455 2023-09-29 17:01:09,158 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-29 17:01:09,159 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-29 17:01:09,710 WARN [Listener at localhost/39529] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 17:01:09,793 WARN [Listener at localhost/39529] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-29 17:01:09,815 WARN [Listener at localhost/39529] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:09,877 INFO [Listener at localhost/39529] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:09,883 INFO [Listener at localhost/39529] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_localhost_35863_datanode____c8tj22/webapp 2023-09-29 17:01:09,985 INFO [Listener at localhost/39529] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35863 2023-09-29 17:01:10,395 WARN [Listener at localhost/32993] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 17:01:10,409 WARN [Listener at localhost/32993] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-29 17:01:10,413 WARN [Listener at localhost/32993] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:10,416 INFO [Listener at localhost/32993] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:10,426 INFO [Listener at localhost/32993] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_localhost_42223_datanode____eu6d5o/webapp 2023-09-29 17:01:10,569 INFO [Listener at localhost/32993] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42223 2023-09-29 17:01:10,589 WARN [Listener at localhost/36625] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 17:01:10,617 WARN [Listener at localhost/36625] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-29 17:01:10,621 WARN [Listener at localhost/36625] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:10,624 INFO [Listener at localhost/36625] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:10,634 INFO [Listener at localhost/36625] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_localhost_42269_datanode____nb71r2/webapp 2023-09-29 17:01:10,765 INFO [Listener at localhost/36625] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42269 2023-09-29 17:01:10,782 WARN [Listener at localhost/35437] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 17:01:10,970 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dd0214ae137c984: Processing first storage report for DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea from datanode 96ec9e29-e704-4387-9076-2ae44666f02d 2023-09-29 17:01:10,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dd0214ae137c984: from storage DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea node DatanodeRegistration(127.0.0.1:44157, datanodeUuid=96ec9e29-e704-4387-9076-2ae44666f02d, infoPort=33209, infoSecurePort=0, ipcPort=36625, storageInfo=lv=-57;cid=testClusterID;nsid=1855186671;c=1696006868491), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-29 17:01:10,972 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c8696c454e28bf8: Processing first storage report for DS-f689329d-e27b-44af-909d-6dcdc5579b69 from datanode 387289f8-5563-46a1-a712-5c985f7939e6 2023-09-29 17:01:10,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c8696c454e28bf8: from storage DS-f689329d-e27b-44af-909d-6dcdc5579b69 node DatanodeRegistration(127.0.0.1:34389, datanodeUuid=387289f8-5563-46a1-a712-5c985f7939e6, infoPort=33797, infoSecurePort=0, ipcPort=35437, storageInfo=lv=-57;cid=testClusterID;nsid=1855186671;c=1696006868491), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 17:01:10,972 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4918a20ed81cc903: Processing first storage report for DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0 from datanode a702c466-2269-4b88-ae0c-f77d1de5bb7b 2023-09-29 17:01:10,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4918a20ed81cc903: from storage DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0 node DatanodeRegistration(127.0.0.1:39047, datanodeUuid=a702c466-2269-4b88-ae0c-f77d1de5bb7b, infoPort=46131, infoSecurePort=0, ipcPort=32993, storageInfo=lv=-57;cid=testClusterID;nsid=1855186671;c=1696006868491), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 17:01:10,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dd0214ae137c984: Processing first storage report for DS-163dcd12-d153-4c19-a2c4-d187daa22bf8 from datanode 96ec9e29-e704-4387-9076-2ae44666f02d 2023-09-29 17:01:10,973 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dd0214ae137c984: from storage DS-163dcd12-d153-4c19-a2c4-d187daa22bf8 node DatanodeRegistration(127.0.0.1:44157, datanodeUuid=96ec9e29-e704-4387-9076-2ae44666f02d, infoPort=33209, infoSecurePort=0, ipcPort=36625, storageInfo=lv=-57;cid=testClusterID;nsid=1855186671;c=1696006868491), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 17:01:10,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c8696c454e28bf8: Processing first storage report for DS-f6a1ee3a-3d1d-4105-9a45-90a510fcf5ed from datanode 387289f8-5563-46a1-a712-5c985f7939e6 2023-09-29 17:01:10,973 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c8696c454e28bf8: from storage DS-f6a1ee3a-3d1d-4105-9a45-90a510fcf5ed node DatanodeRegistration(127.0.0.1:34389, datanodeUuid=387289f8-5563-46a1-a712-5c985f7939e6, infoPort=33797, infoSecurePort=0, ipcPort=35437, storageInfo=lv=-57;cid=testClusterID;nsid=1855186671;c=1696006868491), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 17:01:10,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4918a20ed81cc903: Processing first storage report for DS-2926c53c-3ec5-4fa0-82f9-6ed2a90e71a1 from datanode a702c466-2269-4b88-ae0c-f77d1de5bb7b 2023-09-29 17:01:10,973 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4918a20ed81cc903: from storage DS-2926c53c-3ec5-4fa0-82f9-6ed2a90e71a1 node DatanodeRegistration(127.0.0.1:39047, datanodeUuid=a702c466-2269-4b88-ae0c-f77d1de5bb7b, infoPort=46131, infoSecurePort=0, ipcPort=32993, storageInfo=lv=-57;cid=testClusterID;nsid=1855186671;c=1696006868491), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-29 17:01:11,257 DEBUG [Listener at localhost/35437] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd 2023-09-29 17:01:11,356 INFO [Listener at localhost/35437] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/zookeeper_0, clientPort=64917, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-29 17:01:11,376 INFO [Listener at localhost/35437] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64917 2023-09-29 17:01:11,387 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:11,390 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:12,107 INFO [Listener at localhost/35437] util.FSUtils(471): Created version file at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd with version=8 2023-09-29 17:01:12,107 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/hbase-staging 2023-09-29 17:01:12,470 INFO [Listener at localhost/35437] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-29 17:01:12,951 INFO [Listener at localhost/35437] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 17:01:12,985 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:12,985 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:12,986 INFO [Listener at localhost/35437] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 17:01:12,986 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:12,986 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 17:01:13,133 INFO [Listener at localhost/35437] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 17:01:13,213 DEBUG [Listener at localhost/35437] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-29 17:01:13,311 INFO [Listener at localhost/35437] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45867 2023-09-29 17:01:13,324 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,326 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,351 INFO [Listener at localhost/35437] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45867 connecting to ZooKeeper ensemble=127.0.0.1:64917 2023-09-29 17:01:13,412 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:458670x0, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 17:01:13,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45867-0x100f8a250cc0000 connected 2023-09-29 17:01:13,451 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 17:01:13,452 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:01:13,472 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 17:01:13,483 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45867 2023-09-29 17:01:13,483 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45867 2023-09-29 17:01:13,484 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45867 2023-09-29 17:01:13,485 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45867 2023-09-29 17:01:13,485 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45867 2023-09-29 17:01:13,492 INFO [Listener at localhost/35437] master.HMaster(444): hbase.rootdir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, hbase.cluster.distributed=false 2023-09-29 17:01:13,558 INFO [Listener at localhost/35437] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 17:01:13,558 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,558 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,558 INFO [Listener at localhost/35437] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 17:01:13,558 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,558 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 17:01:13,563 INFO [Listener at localhost/35437] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 17:01:13,566 INFO [Listener at localhost/35437] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45619 2023-09-29 17:01:13,569 INFO [Listener at localhost/35437] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-29 17:01:13,576 INFO [Listener at localhost/35437] mob.MobFileCache(125): MobFileCache disabled 2023-09-29 17:01:13,577 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,579 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,583 INFO [Listener at localhost/35437] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45619 connecting to ZooKeeper ensemble=127.0.0.1:64917 2023-09-29 17:01:13,587 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:456190x0, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 17:01:13,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45619-0x100f8a250cc0001 connected 2023-09-29 17:01:13,588 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 17:01:13,590 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:01:13,591 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 17:01:13,592 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45619 2023-09-29 17:01:13,592 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45619 2023-09-29 17:01:13,592 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45619 2023-09-29 17:01:13,593 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45619 2023-09-29 17:01:13,593 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45619 2023-09-29 17:01:13,607 INFO [Listener at localhost/35437] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 17:01:13,607 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,608 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,608 INFO [Listener at localhost/35437] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 17:01:13,609 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,609 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 17:01:13,609 INFO [Listener at localhost/35437] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 17:01:13,613 INFO [Listener at localhost/35437] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44759 2023-09-29 17:01:13,614 INFO [Listener at localhost/35437] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-29 17:01:13,617 INFO [Listener at localhost/35437] mob.MobFileCache(125): MobFileCache disabled 2023-09-29 17:01:13,618 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,621 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,625 INFO [Listener at localhost/35437] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44759 connecting to ZooKeeper ensemble=127.0.0.1:64917 2023-09-29 17:01:13,633 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:447590x0, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 17:01:13,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44759-0x100f8a250cc0002 connected 2023-09-29 17:01:13,635 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 17:01:13,636 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:01:13,637 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 17:01:13,641 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44759 2023-09-29 17:01:13,641 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44759 2023-09-29 17:01:13,642 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44759 2023-09-29 17:01:13,643 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44759 2023-09-29 17:01:13,644 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44759 2023-09-29 17:01:13,657 INFO [Listener at localhost/35437] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 17:01:13,657 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,657 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,657 INFO [Listener at localhost/35437] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 17:01:13,657 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 17:01:13,657 INFO [Listener at localhost/35437] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 17:01:13,657 INFO [Listener at localhost/35437] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 17:01:13,660 INFO [Listener at localhost/35437] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44811 2023-09-29 17:01:13,661 INFO [Listener at localhost/35437] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-29 17:01:13,662 INFO [Listener at localhost/35437] mob.MobFileCache(125): MobFileCache disabled 2023-09-29 17:01:13,663 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,664 INFO [Listener at localhost/35437] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,666 INFO [Listener at localhost/35437] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44811 connecting to ZooKeeper ensemble=127.0.0.1:64917 2023-09-29 17:01:13,670 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:448110x0, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 17:01:13,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44811-0x100f8a250cc0003 connected 2023-09-29 17:01:13,671 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 17:01:13,672 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:01:13,673 DEBUG [Listener at localhost/35437] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 17:01:13,674 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44811 2023-09-29 17:01:13,675 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44811 2023-09-29 17:01:13,677 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44811 2023-09-29 17:01:13,680 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44811 2023-09-29 17:01:13,680 DEBUG [Listener at localhost/35437] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44811 2023-09-29 17:01:13,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:13,693 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-29 17:01:13,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:13,713 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 17:01:13,713 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 17:01:13,713 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 17:01:13,713 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 17:01:13,714 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:13,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-29 17:01:13,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45867,1696006872285 from backup master directory 2023-09-29 17:01:13,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-29 17:01:13,722 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:13,722 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-29 17:01:13,723 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 17:01:13,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:13,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-29 17:01:13,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-29 17:01:13,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/hbase.id with ID: 212b357b-1df9-4a01-bd56-c9fb429ffabf 2023-09-29 17:01:13,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 17:01:13,902 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:13,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x17258fa1 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:14,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3face804, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:14,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-29 17:01:14,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-29 17:01:14,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-29 17:01:14,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-29 17:01:14,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-29 17:01:14,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-29 17:01:14,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 17:01:14,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store-tmp 2023-09-29 17:01:14,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:14,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-29 17:01:14,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:01:14,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:01:14,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-29 17:01:14,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:01:14,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:01:14,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-29 17:01:14,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/WALs/jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:14,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45867%2C1696006872285, suffix=, logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/WALs/jenkins-hbase4.apache.org,45867,1696006872285, archiveDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/oldWALs, maxLogs=10 2023-09-29 17:01:14,238 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK] 2023-09-29 17:01:14,238 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK] 2023-09-29 17:01:14,238 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK] 2023-09-29 17:01:14,248 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-29 17:01:14,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/WALs/jenkins-hbase4.apache.org,45867,1696006872285/jenkins-hbase4.apache.org%2C45867%2C1696006872285.1696006874190 2023-09-29 17:01:14,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK], DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK], DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK]] 2023-09-29 17:01:14,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-29 17:01:14,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:14,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-29 17:01:14,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-29 17:01:14,400 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-29 17:01:14,407 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-29 17:01:14,436 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-29 17:01:14,449 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:14,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-29 17:01:14,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-29 17:01:14,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-29 17:01:14,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:14,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64352562, jitterRate=-0.04107210040092468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:14,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-29 17:01:14,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-29 17:01:14,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-29 17:01:14,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-29 17:01:14,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-29 17:01:14,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-29 17:01:14,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 38 msec 2023-09-29 17:01:14,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-29 17:01:14,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-29 17:01:14,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-29 17:01:14,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-29 17:01:14,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-29 17:01:14,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-29 17:01:14,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-29 17:01:14,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-29 17:01:14,635 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:14,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-29 17:01:14,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-29 17:01:14,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-29 17:01:14,661 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 17:01:14,661 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 17:01:14,661 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 17:01:14,662 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:14,661 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 17:01:14,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45867,1696006872285, sessionid=0x100f8a250cc0000, setting cluster-up flag (Was=false) 2023-09-29 17:01:14,680 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:14,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-29 17:01:14,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:14,694 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:14,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-29 17:01:14,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:14,706 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp 2023-09-29 17:01:14,786 INFO [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(951): ClusterId : 212b357b-1df9-4a01-bd56-c9fb429ffabf 2023-09-29 17:01:14,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-29 17:01:14,787 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(951): ClusterId : 212b357b-1df9-4a01-bd56-c9fb429ffabf 2023-09-29 17:01:14,788 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(951): ClusterId : 212b357b-1df9-4a01-bd56-c9fb429ffabf 2023-09-29 17:01:14,794 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-29 17:01:14,794 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-29 17:01:14,794 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-29 17:01:14,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:14,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-29 17:01:14,803 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-29 17:01:14,803 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-29 17:01:14,803 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-29 17:01:14,803 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-29 17:01:14,803 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-29 17:01:14,804 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-29 17:01:14,808 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-29 17:01:14,808 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-29 17:01:14,808 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-29 17:01:14,813 DEBUG [RS:1;jenkins-hbase4:44759] zookeeper.ReadOnlyZKClient(139): Connect 0x0bca26ef to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:14,815 DEBUG [RS:0;jenkins-hbase4:45619] zookeeper.ReadOnlyZKClient(139): Connect 0x5a4851c6 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:14,815 DEBUG [RS:2;jenkins-hbase4:44811] zookeeper.ReadOnlyZKClient(139): Connect 0x511f2592 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:14,826 DEBUG [RS:2;jenkins-hbase4:44811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fd8d1c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:14,827 DEBUG [RS:2;jenkins-hbase4:44811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5be74ee2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 17:01:14,828 DEBUG [RS:1;jenkins-hbase4:44759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50dd9e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:14,828 DEBUG [RS:1;jenkins-hbase4:44759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1324d9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 17:01:14,858 DEBUG [RS:0;jenkins-hbase4:45619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@548fb4ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:14,859 DEBUG [RS:0;jenkins-hbase4:45619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15b2bec4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 17:01:14,876 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44811 2023-09-29 17:01:14,876 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45619 2023-09-29 17:01:14,876 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44759 2023-09-29 17:01:14,881 INFO [RS:2;jenkins-hbase4:44811] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-29 17:01:14,881 INFO [RS:0;jenkins-hbase4:45619] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-29 17:01:14,882 INFO [RS:0;jenkins-hbase4:45619] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-29 17:01:14,881 INFO [RS:1;jenkins-hbase4:44759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-29 17:01:14,882 INFO [RS:2;jenkins-hbase4:44811] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-29 17:01:14,882 INFO [RS:1;jenkins-hbase4:44759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-29 17:01:14,883 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-29 17:01:14,883 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-29 17:01:14,883 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-29 17:01:14,883 INFO [RS:2;jenkins-hbase4:44811] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:14,884 INFO [RS:1;jenkins-hbase4:44759] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:14,884 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1022): About to register with Master. 2023-09-29 17:01:14,884 INFO [RS:0;jenkins-hbase4:45619] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:14,884 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1022): About to register with Master. 2023-09-29 17:01:14,884 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1022): About to register with Master. 2023-09-29 17:01:14,887 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45867,1696006872285 with isa=jenkins-hbase4.apache.org/172.31.14.131:44759, startcode=1696006873606 2023-09-29 17:01:14,887 INFO [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45867,1696006872285 with isa=jenkins-hbase4.apache.org/172.31.14.131:45619, startcode=1696006873557 2023-09-29 17:01:14,887 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45867,1696006872285 with isa=jenkins-hbase4.apache.org/172.31.14.131:44811, startcode=1696006873656 2023-09-29 17:01:14,907 DEBUG [RS:0;jenkins-hbase4:45619] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-29 17:01:14,907 DEBUG [RS:1;jenkins-hbase4:44759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-29 17:01:14,907 DEBUG [RS:2;jenkins-hbase4:44811] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-29 17:01:14,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 17:01:14,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:14,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696006904926 2023-09-29 17:01:14,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-29 17:01:14,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-29 17:01:14,949 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-29 17:01:14,950 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-29 17:01:14,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-29 17:01:14,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-29 17:01:14,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-29 17:01:14,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-29 17:01:14,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:14,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-29 17:01:14,958 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-29 17:01:14,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-29 17:01:14,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-29 17:01:14,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-29 17:01:14,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-29 17:01:14,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696006874967,5,FailOnTimeoutGroup] 2023-09-29 17:01:14,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696006874969,5,FailOnTimeoutGroup] 2023-09-29 17:01:14,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:14,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-29 17:01:14,970 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59399, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-29 17:01:14,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:14,970 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57533, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-29 17:01:14,970 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55141, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-29 17:01:14,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:14,987 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,009 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,010 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,010 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-29 17:01:15,012 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-29 17:01:15,012 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:15,017 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:15,017 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:15,017 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:15,018 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39529 2023-09-29 17:01:15,017 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39529 2023-09-29 17:01:15,018 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-29 17:01:15,018 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39529 2023-09-29 17:01:15,018 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-29 17:01:15,019 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-29 17:01:15,030 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 17:01:15,032 DEBUG [RS:1;jenkins-hbase4:44759] zookeeper.ZKUtil(162): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,033 WARN [RS:1;jenkins-hbase4:44759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 17:01:15,033 INFO [RS:1;jenkins-hbase4:44759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 17:01:15,033 DEBUG [RS:0;jenkins-hbase4:45619] zookeeper.ZKUtil(162): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,034 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,034 WARN [RS:0;jenkins-hbase4:45619] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 17:01:15,034 INFO [RS:0;jenkins-hbase4:45619] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 17:01:15,035 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,035 DEBUG [RS:2;jenkins-hbase4:44811] zookeeper.ZKUtil(162): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,035 WARN [RS:2;jenkins-hbase4:44811] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 17:01:15,036 INFO [RS:2;jenkins-hbase4:44811] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 17:01:15,036 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,039 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44759,1696006873606] 2023-09-29 17:01:15,039 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44811,1696006873656] 2023-09-29 17:01:15,039 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45619,1696006873557] 2023-09-29 17:01:15,052 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:15,055 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-29 17:01:15,057 DEBUG [RS:2;jenkins-hbase4:44811] zookeeper.ZKUtil(162): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,057 DEBUG [RS:0;jenkins-hbase4:45619] zookeeper.ZKUtil(162): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,057 DEBUG [RS:1;jenkins-hbase4:44759] zookeeper.ZKUtil(162): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,058 DEBUG [RS:2;jenkins-hbase4:44811] zookeeper.ZKUtil(162): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,058 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/info 2023-09-29 17:01:15,058 DEBUG [RS:0;jenkins-hbase4:45619] zookeeper.ZKUtil(162): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,058 DEBUG [RS:2;jenkins-hbase4:44811] zookeeper.ZKUtil(162): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,058 DEBUG [RS:1;jenkins-hbase4:44759] zookeeper.ZKUtil(162): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,059 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-29 17:01:15,059 DEBUG [RS:1;jenkins-hbase4:44759] zookeeper.ZKUtil(162): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,059 DEBUG [RS:0;jenkins-hbase4:45619] zookeeper.ZKUtil(162): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,061 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:15,061 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-29 17:01:15,064 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/rep_barrier 2023-09-29 17:01:15,065 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-29 17:01:15,066 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:15,066 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-29 17:01:15,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/table 2023-09-29 17:01:15,069 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-29 17:01:15,071 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:15,073 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740 2023-09-29 17:01:15,074 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-29 17:01:15,074 DEBUG [RS:0;jenkins-hbase4:45619] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-29 17:01:15,075 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740 2023-09-29 17:01:15,074 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-29 17:01:15,080 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-29 17:01:15,083 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-29 17:01:15,088 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:15,089 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75018838, jitterRate=0.11786779761314392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-29 17:01:15,089 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-29 17:01:15,089 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-29 17:01:15,089 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-29 17:01:15,089 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-29 17:01:15,089 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-29 17:01:15,089 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-29 17:01:15,090 INFO [RS:2;jenkins-hbase4:44811] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-29 17:01:15,090 INFO [RS:1;jenkins-hbase4:44759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-29 17:01:15,090 INFO [RS:0;jenkins-hbase4:45619] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-29 17:01:15,092 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-29 17:01:15,092 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-29 17:01:15,098 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-29 17:01:15,098 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-29 17:01:15,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-29 17:01:15,123 INFO [RS:0;jenkins-hbase4:45619] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-29 17:01:15,123 INFO [RS:1;jenkins-hbase4:44759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-29 17:01:15,126 INFO [RS:2;jenkins-hbase4:44811] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-29 17:01:15,128 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-29 17:01:15,131 INFO [RS:0;jenkins-hbase4:45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-29 17:01:15,132 INFO [RS:1;jenkins-hbase4:44759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-29 17:01:15,132 INFO [RS:0;jenkins-hbase4:45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,131 INFO [RS:2;jenkins-hbase4:44811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-29 17:01:15,132 INFO [RS:1;jenkins-hbase4:44759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,133 INFO [RS:2;jenkins-hbase4:44811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,133 INFO [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-29 17:01:15,137 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-29 17:01:15,137 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-29 17:01:15,139 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-29 17:01:15,147 INFO [RS:0;jenkins-hbase4:45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,147 INFO [RS:1;jenkins-hbase4:44759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,147 INFO [RS:2;jenkins-hbase4:44811] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,147 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,148 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,148 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,148 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,148 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,148 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 17:01:15,148 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:2;jenkins-hbase4:44811] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:0;jenkins-hbase4:45619] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,149 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,150 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,151 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 17:01:15,151 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,151 INFO [RS:2;jenkins-hbase4:44811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,151 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,151 INFO [RS:2;jenkins-hbase4:44811] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,151 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,151 INFO [RS:2;jenkins-hbase4:44811] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,151 DEBUG [RS:1;jenkins-hbase4:44759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 17:01:15,153 INFO [RS:0;jenkins-hbase4:45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,153 INFO [RS:0;jenkins-hbase4:45619] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,153 INFO [RS:1;jenkins-hbase4:44759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,153 INFO [RS:0;jenkins-hbase4:45619] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,153 INFO [RS:1;jenkins-hbase4:44759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,153 INFO [RS:1;jenkins-hbase4:44759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,172 INFO [RS:0;jenkins-hbase4:45619] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-29 17:01:15,172 INFO [RS:1;jenkins-hbase4:44759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-29 17:01:15,172 INFO [RS:2;jenkins-hbase4:44811] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-29 17:01:15,175 INFO [RS:0;jenkins-hbase4:45619] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45619,1696006873557-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,175 INFO [RS:1;jenkins-hbase4:44759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44759,1696006873606-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,176 INFO [RS:2;jenkins-hbase4:44811] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44811,1696006873656-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,196 INFO [RS:0;jenkins-hbase4:45619] regionserver.Replication(203): jenkins-hbase4.apache.org,45619,1696006873557 started 2023-09-29 17:01:15,196 INFO [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45619,1696006873557, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45619, sessionid=0x100f8a250cc0001 2023-09-29 17:01:15,196 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-29 17:01:15,196 DEBUG [RS:0;jenkins-hbase4:45619] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,196 DEBUG [RS:0;jenkins-hbase4:45619] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45619,1696006873557' 2023-09-29 17:01:15,196 DEBUG [RS:0;jenkins-hbase4:45619] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-29 17:01:15,197 DEBUG [RS:0;jenkins-hbase4:45619] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-29 17:01:15,197 INFO [RS:1;jenkins-hbase4:44759] regionserver.Replication(203): jenkins-hbase4.apache.org,44759,1696006873606 started 2023-09-29 17:01:15,197 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44759,1696006873606, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44759, sessionid=0x100f8a250cc0002 2023-09-29 17:01:15,197 INFO [RS:2;jenkins-hbase4:44811] regionserver.Replication(203): jenkins-hbase4.apache.org,44811,1696006873656 started 2023-09-29 17:01:15,197 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-29 17:01:15,198 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44811,1696006873656, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44811, sessionid=0x100f8a250cc0003 2023-09-29 17:01:15,198 DEBUG [RS:1;jenkins-hbase4:44759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,198 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-29 17:01:15,198 DEBUG [RS:1;jenkins-hbase4:44759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44759,1696006873606' 2023-09-29 17:01:15,199 DEBUG [RS:1;jenkins-hbase4:44759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-29 17:01:15,198 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-29 17:01:15,199 DEBUG [RS:2;jenkins-hbase4:44811] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,199 DEBUG [RS:2;jenkins-hbase4:44811] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44811,1696006873656' 2023-09-29 17:01:15,199 DEBUG [RS:2;jenkins-hbase4:44811] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-29 17:01:15,199 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-29 17:01:15,199 DEBUG [RS:0;jenkins-hbase4:45619] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:15,199 DEBUG [RS:0;jenkins-hbase4:45619] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45619,1696006873557' 2023-09-29 17:01:15,199 DEBUG [RS:1;jenkins-hbase4:44759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-29 17:01:15,199 DEBUG [RS:0;jenkins-hbase4:45619] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:15,200 DEBUG [RS:2;jenkins-hbase4:44811] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-29 17:01:15,200 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-29 17:01:15,200 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-29 17:01:15,200 DEBUG [RS:0;jenkins-hbase4:45619] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:15,200 DEBUG [RS:1;jenkins-hbase4:44759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,201 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-29 17:01:15,201 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-29 17:01:15,201 DEBUG [RS:2;jenkins-hbase4:44811] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:15,201 DEBUG [RS:1;jenkins-hbase4:44759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44759,1696006873606' 2023-09-29 17:01:15,201 DEBUG [RS:0;jenkins-hbase4:45619] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-29 17:01:15,201 DEBUG [RS:1;jenkins-hbase4:44759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:15,201 DEBUG [RS:2;jenkins-hbase4:44811] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44811,1696006873656' 2023-09-29 17:01:15,202 DEBUG [RS:2;jenkins-hbase4:44811] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:15,201 INFO [RS:0;jenkins-hbase4:45619] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-29 17:01:15,202 INFO [RS:0;jenkins-hbase4:45619] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-29 17:01:15,202 DEBUG [RS:2;jenkins-hbase4:44811] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:15,202 DEBUG [RS:1;jenkins-hbase4:44759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:15,204 DEBUG [RS:1;jenkins-hbase4:44759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-29 17:01:15,204 DEBUG [RS:2;jenkins-hbase4:44811] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-29 17:01:15,204 INFO [RS:1;jenkins-hbase4:44759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-29 17:01:15,205 INFO [RS:2;jenkins-hbase4:44811] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-29 17:01:15,205 INFO [RS:1;jenkins-hbase4:44759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-29 17:01:15,206 INFO [RS:2;jenkins-hbase4:44811] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-29 17:01:15,291 DEBUG [jenkins-hbase4:45867] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-29 17:01:15,297 DEBUG [jenkins-hbase4:45867] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:01:15,303 DEBUG [jenkins-hbase4:45867] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:01:15,303 DEBUG [jenkins-hbase4:45867] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:01:15,303 DEBUG [jenkins-hbase4:45867] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:01:15,303 DEBUG [jenkins-hbase4:45867] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:01:15,306 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44759,1696006873606, state=OPENING 2023-09-29 17:01:15,316 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-29 17:01:15,317 INFO [RS:2;jenkins-hbase4:44811] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44811%2C1696006873656, suffix=, logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44811,1696006873656, archiveDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs, maxLogs=32 2023-09-29 17:01:15,318 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:15,317 INFO [RS:0;jenkins-hbase4:45619] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45619%2C1696006873557, suffix=, logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,45619,1696006873557, archiveDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs, maxLogs=32 2023-09-29 17:01:15,318 INFO [RS:1;jenkins-hbase4:44759] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44759%2C1696006873606, suffix=, logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44759,1696006873606, archiveDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs, maxLogs=32 2023-09-29 17:01:15,319 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-29 17:01:15,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:01:15,351 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK] 2023-09-29 17:01:15,351 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK] 2023-09-29 17:01:15,354 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK] 2023-09-29 17:01:15,369 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK] 2023-09-29 17:01:15,369 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK] 2023-09-29 17:01:15,371 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK] 2023-09-29 17:01:15,372 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK] 2023-09-29 17:01:15,372 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK] 2023-09-29 17:01:15,383 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK] 2023-09-29 17:01:15,386 INFO [RS:0;jenkins-hbase4:45619] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,45619,1696006873557/jenkins-hbase4.apache.org%2C45619%2C1696006873557.1696006875324 2023-09-29 17:01:15,394 DEBUG [RS:0;jenkins-hbase4:45619] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK], DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK], DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK]] 2023-09-29 17:01:15,395 INFO [RS:1;jenkins-hbase4:44759] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44759,1696006873606/jenkins-hbase4.apache.org%2C44759%2C1696006873606.1696006875325 2023-09-29 17:01:15,396 INFO [RS:2;jenkins-hbase4:44811] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44811,1696006873656/jenkins-hbase4.apache.org%2C44811%2C1696006873656.1696006875325 2023-09-29 17:01:15,396 DEBUG [RS:1;jenkins-hbase4:44759] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK], DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK], DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK]] 2023-09-29 17:01:15,397 DEBUG [RS:2;jenkins-hbase4:44811] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK], DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK], DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK]] 2023-09-29 17:01:15,512 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:15,516 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 17:01:15,520 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 17:01:15,536 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-29 17:01:15,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 17:01:15,541 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44759%2C1696006873606.meta, suffix=.meta, logDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44759,1696006873606, archiveDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs, maxLogs=32 2023-09-29 17:01:15,562 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK] 2023-09-29 17:01:15,563 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK] 2023-09-29 17:01:15,564 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK] 2023-09-29 17:01:15,570 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/WALs/jenkins-hbase4.apache.org,44759,1696006873606/jenkins-hbase4.apache.org%2C44759%2C1696006873606.meta.1696006875542.meta 2023-09-29 17:01:15,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34389,DS-f689329d-e27b-44af-909d-6dcdc5579b69,DISK], DatanodeInfoWithStorage[127.0.0.1:44157,DS-8623b4e1-b1fa-4fd1-88d3-861866ad43ea,DISK], DatanodeInfoWithStorage[127.0.0.1:39047,DS-88c3c05f-cf25-40ca-871b-bdfb68abfff0,DISK]] 2023-09-29 17:01:15,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-29 17:01:15,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-29 17:01:15,574 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:15,575 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-29 17:01:15,577 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-29 17:01:15,579 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-29 17:01:15,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-29 17:01:15,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:15,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-29 17:01:15,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-29 17:01:15,600 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-29 17:01:15,602 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/info 2023-09-29 17:01:15,603 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/info 2023-09-29 17:01:15,603 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-29 17:01:15,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:15,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-29 17:01:15,607 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/rep_barrier 2023-09-29 17:01:15,607 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/rep_barrier 2023-09-29 17:01:15,607 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-29 17:01:15,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:15,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-29 17:01:15,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/table 2023-09-29 17:01:15,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/table 2023-09-29 17:01:15,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-29 17:01:15,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:15,615 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740 2023-09-29 17:01:15,620 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740 2023-09-29 17:01:15,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-29 17:01:15,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-29 17:01:15,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61198658, jitterRate=-0.08806893229484558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-29 17:01:15,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-29 17:01:15,647 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696006875504 2023-09-29 17:01:15,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-29 17:01:15,669 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-29 17:01:15,669 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44759,1696006873606, state=OPEN 2023-09-29 17:01:15,672 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-29 17:01:15,673 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-29 17:01:15,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-29 17:01:15,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44759,1696006873606 in 349 msec 2023-09-29 17:01:15,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-29 17:01:15,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 568 msec 2023-09-29 17:01:15,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 882 msec 2023-09-29 17:01:15,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696006875690, completionTime=-1 2023-09-29 17:01:15,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-29 17:01:15,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-29 17:01:15,762 DEBUG [hconnection-0x4d53de13-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:15,765 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:15,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-29 17:01:15,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696006935787 2023-09-29 17:01:15,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696006995787 2023-09-29 17:01:15,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 97 msec 2023-09-29 17:01:15,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45867,1696006872285-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45867,1696006872285-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45867,1696006872285-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45867, period=300000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-29 17:01:15,828 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-29 17:01:15,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-29 17:01:15,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-29 17:01:15,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-29 17:01:15,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:01:15,859 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:01:15,883 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:15,886 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5 empty. 2023-09-29 17:01:15,886 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:15,886 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-29 17:01:15,926 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-29 17:01:15,929 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6deb34af46634b50fb84a49c53039ea5, NAME => 'hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:15,954 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:15,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 6deb34af46634b50fb84a49c53039ea5, disabling compactions & flushes 2023-09-29 17:01:15,955 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:01:15,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:01:15,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. after waiting 0 ms 2023-09-29 17:01:15,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:01:15,955 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:01:15,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 6deb34af46634b50fb84a49c53039ea5: 2023-09-29 17:01:15,961 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:01:15,977 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696006875964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006875964"}]},"ts":"1696006875964"} 2023-09-29 17:01:16,005 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-29 17:01:16,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:01:16,012 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006876008"}]},"ts":"1696006876008"} 2023-09-29 17:01:16,017 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-29 17:01:16,021 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:01:16,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:01:16,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:01:16,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:01:16,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:01:16,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6deb34af46634b50fb84a49c53039ea5, ASSIGN}] 2023-09-29 17:01:16,030 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6deb34af46634b50fb84a49c53039ea5, ASSIGN 2023-09-29 17:01:16,032 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6deb34af46634b50fb84a49c53039ea5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44811,1696006873656; forceNewPlan=false, retain=false 2023-09-29 17:01:16,184 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-29 17:01:16,185 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6deb34af46634b50fb84a49c53039ea5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:16,186 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696006876185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006876185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006876185"}]},"ts":"1696006876185"} 2023-09-29 17:01:16,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6deb34af46634b50fb84a49c53039ea5, server=jenkins-hbase4.apache.org,44811,1696006873656}] 2023-09-29 17:01:16,345 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:16,346 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 17:01:16,351 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 17:01:16,358 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:01:16,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6deb34af46634b50fb84a49c53039ea5, NAME => 'hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.', STARTKEY => '', ENDKEY => ''} 2023-09-29 17:01:16,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. service=AccessControlService 2023-09-29 17:01:16,359 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:16,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:16,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:16,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:16,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:16,362 INFO [StoreOpener-6deb34af46634b50fb84a49c53039ea5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:16,365 DEBUG [StoreOpener-6deb34af46634b50fb84a49c53039ea5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/info 2023-09-29 17:01:16,365 DEBUG [StoreOpener-6deb34af46634b50fb84a49c53039ea5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/info 2023-09-29 17:01:16,366 INFO [StoreOpener-6deb34af46634b50fb84a49c53039ea5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6deb34af46634b50fb84a49c53039ea5 columnFamilyName info 2023-09-29 17:01:16,366 INFO [StoreOpener-6deb34af46634b50fb84a49c53039ea5-1] regionserver.HStore(310): Store=6deb34af46634b50fb84a49c53039ea5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:16,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:16,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:16,374 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:01:16,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:16,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6deb34af46634b50fb84a49c53039ea5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63379407, jitterRate=-0.0555732399225235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:16,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6deb34af46634b50fb84a49c53039ea5: 2023-09-29 17:01:16,382 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5., pid=6, masterSystemTime=1696006876345 2023-09-29 17:01:16,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:01:16,387 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:01:16,389 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6deb34af46634b50fb84a49c53039ea5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:16,389 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696006876388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006876388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006876388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006876388"}]},"ts":"1696006876388"} 2023-09-29 17:01:16,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-29 17:01:16,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6deb34af46634b50fb84a49c53039ea5, server=jenkins-hbase4.apache.org,44811,1696006873656 in 201 msec 2023-09-29 17:01:16,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-29 17:01:16,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6deb34af46634b50fb84a49c53039ea5, ASSIGN in 370 msec 2023-09-29 17:01:16,403 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:01:16,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006876403"}]},"ts":"1696006876403"} 2023-09-29 17:01:16,407 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-29 17:01:16,411 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:01:16,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 569 msec 2023-09-29 17:01:16,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-29 17:01:16,457 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-29 17:01:16,457 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:16,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:16,481 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:16,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-29 17:01:16,519 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-29 17:01:16,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-09-29 17:01:16,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-29 17:01:16,545 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-29 17:01:16,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-09-29 17:01:16,560 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-29 17:01:16,564 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-29 17:01:16,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.841sec 2023-09-29 17:01:16,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-29 17:01:16,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-29 17:01:16,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-29 17:01:16,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45867,1696006872285-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-29 17:01:16,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45867,1696006872285-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-29 17:01:16,591 DEBUG [Listener at localhost/35437] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:16,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-29 17:01:16,597 DEBUG [Listener at localhost/35437] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:16,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-29 17:01:16,602 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:01:16,606 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:01:16,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-29 17:01:16,609 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:16,610 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab empty. 2023-09-29 17:01:16,614 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:16,616 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-29 17:01:16,618 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:16,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 17:01:16,640 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:16,644 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:01:16,644 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-29 17:01:16,644 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/test.cache.data in system properties and HBase conf 2023-09-29 17:01:16,644 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop.tmp.dir in system properties and HBase conf 2023-09-29 17:01:16,644 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop.log.dir in system properties and HBase conf 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-29 17:01:16,645 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-29 17:01:16,645 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/nfs.dump.dir in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-29 17:01:16,646 INFO [Listener at localhost/35437] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-29 17:01:16,647 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ffce55fc122492b057ac52d6fcecdfab, NAME => 'hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:16,672 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:16,672 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ffce55fc122492b057ac52d6fcecdfab, disabling compactions & flushes 2023-09-29 17:01:16,672 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:01:16,672 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:01:16,672 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. after waiting 0 ms 2023-09-29 17:01:16,672 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:01:16,672 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:01:16,672 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ffce55fc122492b057ac52d6fcecdfab: 2023-09-29 17:01:16,677 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:01:16,679 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696006876679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006876679"}]},"ts":"1696006876679"} 2023-09-29 17:01:16,682 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-29 17:01:16,684 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:01:16,684 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006876684"}]},"ts":"1696006876684"} 2023-09-29 17:01:16,687 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-29 17:01:16,692 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:01:16,694 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:01:16,694 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:01:16,694 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:01:16,694 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:01:16,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ffce55fc122492b057ac52d6fcecdfab, ASSIGN}] 2023-09-29 17:01:16,698 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ffce55fc122492b057ac52d6fcecdfab, ASSIGN 2023-09-29 17:01:16,700 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ffce55fc122492b057ac52d6fcecdfab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44759,1696006873606; forceNewPlan=false, retain=false 2023-09-29 17:01:16,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 17:01:16,850 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-29 17:01:16,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ffce55fc122492b057ac52d6fcecdfab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:16,852 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696006876851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006876851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006876851"}]},"ts":"1696006876851"} 2023-09-29 17:01:16,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ffce55fc122492b057ac52d6fcecdfab, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:01:16,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 17:01:17,018 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:01:17,018 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ffce55fc122492b057ac52d6fcecdfab, NAME => 'hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.', STARTKEY => '', ENDKEY => ''} 2023-09-29 17:01:17,018 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. service=AccessControlService 2023-09-29 17:01:17,019 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:17,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:17,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:17,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:17,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:17,022 INFO [StoreOpener-ffce55fc122492b057ac52d6fcecdfab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:17,024 DEBUG [StoreOpener-ffce55fc122492b057ac52d6fcecdfab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/l 2023-09-29 17:01:17,025 DEBUG [StoreOpener-ffce55fc122492b057ac52d6fcecdfab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/l 2023-09-29 17:01:17,025 INFO [StoreOpener-ffce55fc122492b057ac52d6fcecdfab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffce55fc122492b057ac52d6fcecdfab columnFamilyName l 2023-09-29 17:01:17,026 INFO [StoreOpener-ffce55fc122492b057ac52d6fcecdfab-1] regionserver.HStore(310): Store=ffce55fc122492b057ac52d6fcecdfab/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:17,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:17,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:17,036 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:01:17,042 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:17,043 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ffce55fc122492b057ac52d6fcecdfab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67052093, jitterRate=-8.459538221359253E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:17,044 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ffce55fc122492b057ac52d6fcecdfab: 2023-09-29 17:01:17,048 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab., pid=11, masterSystemTime=1696006877010 2023-09-29 17:01:17,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:01:17,051 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:01:17,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ffce55fc122492b057ac52d6fcecdfab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:17,052 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696006877052"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006877052"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006877052"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006877052"}]},"ts":"1696006877052"} 2023-09-29 17:01:17,059 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-29 17:01:17,059 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ffce55fc122492b057ac52d6fcecdfab, server=jenkins-hbase4.apache.org,44759,1696006873606 in 199 msec 2023-09-29 17:01:17,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-29 17:01:17,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ffce55fc122492b057ac52d6fcecdfab, ASSIGN in 365 msec 2023-09-29 17:01:17,067 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:01:17,068 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006877067"}]},"ts":"1696006877067"} 2023-09-29 17:01:17,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-29 17:01:17,075 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:01:17,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 479 msec 2023-09-29 17:01:17,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 17:01:17,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-29 17:01:17,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-29 17:01:17,995 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:18,372 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:18,379 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43541_jobhistory____.z20olg/webapp 2023-09-29 17:01:18,560 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-29 17:01:18,560 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-29 17:01:18,560 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 17:01:18,563 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 17:01:18,654 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:18,989 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:19,253 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-29 17:01:19,286 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43541 2023-09-29 17:01:19,489 WARN [Listener at jenkins-hbase4.apache.org/35019] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:19,770 WARN [Listener at jenkins-hbase4.apache.org/35019] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-29 17:01:19,771 INFO [Listener at jenkins-hbase4.apache.org/35019] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:19,779 INFO [Listener at jenkins-hbase4.apache.org/35019] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34697_cluster____.3vmarz/webapp 2023-09-29 17:01:19,861 INFO [Listener at jenkins-hbase4.apache.org/35019] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-29 17:01:19,861 INFO [Listener at jenkins-hbase4.apache.org/35019] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-29 17:01:19,861 INFO [Listener at jenkins-hbase4.apache.org/35019] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 17:01:19,861 INFO [Listener at jenkins-hbase4.apache.org/35019] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 17:01:19,871 INFO [Listener at jenkins-hbase4.apache.org/35019] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:20,071 INFO [Listener at jenkins-hbase4.apache.org/35019] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:20,153 INFO [Listener at jenkins-hbase4.apache.org/35019] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:20,160 INFO [Listener at jenkins-hbase4.apache.org/35019] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34697 2023-09-29 17:01:20,691 WARN [Listener at jenkins-hbase4.apache.org/35111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:20,719 WARN [Listener at jenkins-hbase4.apache.org/35111] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-29 17:01:20,720 INFO [Listener at jenkins-hbase4.apache.org/35111] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:20,728 INFO [Listener at jenkins-hbase4.apache.org/35111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33773_node____lrttf5/webapp 2023-09-29 17:01:20,780 INFO [Listener at jenkins-hbase4.apache.org/35111] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-29 17:01:20,780 INFO [Listener at jenkins-hbase4.apache.org/35111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 17:01:20,781 INFO [Listener at jenkins-hbase4.apache.org/35111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-29 17:01:20,781 INFO [Listener at jenkins-hbase4.apache.org/35111] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 17:01:20,790 INFO [Listener at jenkins-hbase4.apache.org/35111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:20,810 INFO [Listener at jenkins-hbase4.apache.org/35111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:20,888 INFO [Listener at jenkins-hbase4.apache.org/35111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:20,900 INFO [Listener at jenkins-hbase4.apache.org/35111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33773 2023-09-29 17:01:21,063 WARN [Listener at jenkins-hbase4.apache.org/46659] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 17:01:21,069 WARN [Listener at jenkins-hbase4.apache.org/46659] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-29 17:01:21,070 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 17:01:21,077 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40001_node____gyd0mr/webapp 2023-09-29 17:01:21,129 INFO [Listener at jenkins-hbase4.apache.org/46659] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-29 17:01:21,129 INFO [Listener at jenkins-hbase4.apache.org/46659] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 17:01:21,130 INFO [Listener at jenkins-hbase4.apache.org/46659] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-29 17:01:21,130 INFO [Listener at jenkins-hbase4.apache.org/46659] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 17:01:21,140 INFO [Listener at jenkins-hbase4.apache.org/46659] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:21,154 INFO [Listener at jenkins-hbase4.apache.org/46659] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:21,166 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:01:21,268 INFO [Listener at jenkins-hbase4.apache.org/46659] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 17:01:21,276 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40001 2023-09-29 17:01:21,312 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-29 17:01:21,314 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:01:21,401 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=165, AvailableMemoryMB=1925 2023-09-29 17:01:21,401 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-09-29 17:01:21,404 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-29 17:01:21,406 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-29 17:01:21,407 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-29 17:01:21,420 DEBUG [Listener at jenkins-hbase4.apache.org/46659] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-29 17:01:21,427 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-29 17:01:21,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 17:01:21,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:21,443 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:01:21,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-29 17:01:21,447 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:01:21,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 17:01:21,453 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,456 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033 empty. 2023-09-29 17:01:21,456 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,457 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,459 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc empty. 2023-09-29 17:01:21,461 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,461 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-29 17:01:21,494 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-29 17:01:21,497 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 02acd33601a0a291990c133f4dcd1033, NAME => 'testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:21,497 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 79bb5163b89551ede8a56945cc14ccdc, NAME => 'testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:21,542 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:21,543 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 79bb5163b89551ede8a56945cc14ccdc, disabling compactions & flushes 2023-09-29 17:01:21,543 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:21,543 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:21,543 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. after waiting 0 ms 2023-09-29 17:01:21,543 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:21,543 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:21,544 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:21,544 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 79bb5163b89551ede8a56945cc14ccdc: 2023-09-29 17:01:21,544 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 02acd33601a0a291990c133f4dcd1033, disabling compactions & flushes 2023-09-29 17:01:21,545 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:21,545 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:21,545 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. after waiting 0 ms 2023-09-29 17:01:21,545 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:21,545 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:21,545 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 02acd33601a0a291990c133f4dcd1033: 2023-09-29 17:01:21,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 17:01:21,553 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:01:21,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006881554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006881554"}]},"ts":"1696006881554"} 2023-09-29 17:01:21,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006881554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006881554"}]},"ts":"1696006881554"} 2023-09-29 17:01:21,608 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 17:01:21,609 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:01:21,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006881610"}]},"ts":"1696006881610"} 2023-09-29 17:01:21,612 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-29 17:01:21,617 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:01:21,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:01:21,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:01:21,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:01:21,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:01:21,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02acd33601a0a291990c133f4dcd1033, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79bb5163b89551ede8a56945cc14ccdc, ASSIGN}] 2023-09-29 17:01:21,623 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79bb5163b89551ede8a56945cc14ccdc, ASSIGN 2023-09-29 17:01:21,623 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02acd33601a0a291990c133f4dcd1033, ASSIGN 2023-09-29 17:01:21,625 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79bb5163b89551ede8a56945cc14ccdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44811,1696006873656; forceNewPlan=false, retain=false 2023-09-29 17:01:21,626 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02acd33601a0a291990c133f4dcd1033, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45619,1696006873557; forceNewPlan=false, retain=false 2023-09-29 17:01:21,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 17:01:21,775 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 17:01:21,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=79bb5163b89551ede8a56945cc14ccdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:21,778 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=02acd33601a0a291990c133f4dcd1033, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:21,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006881778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006881778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006881778"}]},"ts":"1696006881778"} 2023-09-29 17:01:21,778 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006881778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006881778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006881778"}]},"ts":"1696006881778"} 2023-09-29 17:01:21,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 79bb5163b89551ede8a56945cc14ccdc, server=jenkins-hbase4.apache.org,44811,1696006873656}] 2023-09-29 17:01:21,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 02acd33601a0a291990c133f4dcd1033, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:01:21,937 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:21,937 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 17:01:21,941 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 17:01:21,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:21,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79bb5163b89551ede8a56945cc14ccdc, NAME => 'testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 17:01:21,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. service=AccessControlService 2023-09-29 17:01:21,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:21,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:21,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:21,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02acd33601a0a291990c133f4dcd1033, NAME => 'testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 17:01:21,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. service=AccessControlService 2023-09-29 17:01:21,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:21,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:21,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,954 INFO [StoreOpener-79bb5163b89551ede8a56945cc14ccdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,956 DEBUG [StoreOpener-79bb5163b89551ede8a56945cc14ccdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf 2023-09-29 17:01:21,956 DEBUG [StoreOpener-79bb5163b89551ede8a56945cc14ccdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf 2023-09-29 17:01:21,961 INFO [StoreOpener-79bb5163b89551ede8a56945cc14ccdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79bb5163b89551ede8a56945cc14ccdc columnFamilyName cf 2023-09-29 17:01:21,963 INFO [StoreOpener-02acd33601a0a291990c133f4dcd1033-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,964 INFO [StoreOpener-79bb5163b89551ede8a56945cc14ccdc-1] regionserver.HStore(310): Store=79bb5163b89551ede8a56945cc14ccdc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:21,967 DEBUG [StoreOpener-02acd33601a0a291990c133f4dcd1033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf 2023-09-29 17:01:21,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,967 DEBUG [StoreOpener-02acd33601a0a291990c133f4dcd1033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf 2023-09-29 17:01:21,968 INFO [StoreOpener-02acd33601a0a291990c133f4dcd1033-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02acd33601a0a291990c133f4dcd1033 columnFamilyName cf 2023-09-29 17:01:21,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,969 INFO [StoreOpener-02acd33601a0a291990c133f4dcd1033-1] regionserver.HStore(310): Store=02acd33601a0a291990c133f4dcd1033/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:21,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:21,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:21,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:21,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79bb5163b89551ede8a56945cc14ccdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73524974, jitterRate=0.09560748934745789}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:21,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79bb5163b89551ede8a56945cc14ccdc: 2023-09-29 17:01:21,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc., pid=15, masterSystemTime=1696006881934 2023-09-29 17:01:21,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:21,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02acd33601a0a291990c133f4dcd1033; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70961994, jitterRate=0.05741611123085022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:21,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02acd33601a0a291990c133f4dcd1033: 2023-09-29 17:01:21,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033., pid=16, masterSystemTime=1696006881937 2023-09-29 17:01:21,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:21,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:22,000 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=79bb5163b89551ede8a56945cc14ccdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,001 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006881999"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006881999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006881999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006881999"}]},"ts":"1696006881999"} 2023-09-29 17:01:22,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:22,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:22,005 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=02acd33601a0a291990c133f4dcd1033, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006882005"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006882005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006882005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006882005"}]},"ts":"1696006882005"} 2023-09-29 17:01:22,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-29 17:01:22,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 79bb5163b89551ede8a56945cc14ccdc, server=jenkins-hbase4.apache.org,44811,1696006873656 in 225 msec 2023-09-29 17:01:22,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79bb5163b89551ede8a56945cc14ccdc, ASSIGN in 390 msec 2023-09-29 17:01:22,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-29 17:01:22,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 02acd33601a0a291990c133f4dcd1033, server=jenkins-hbase4.apache.org,45619,1696006873557 in 226 msec 2023-09-29 17:01:22,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-29 17:01:22,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02acd33601a0a291990c133f4dcd1033, ASSIGN in 397 msec 2023-09-29 17:01:22,021 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:01:22,021 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006882021"}]},"ts":"1696006882021"} 2023-09-29 17:01:22,024 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-29 17:01:22,026 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:01:22,032 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-29 17:01:22,053 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-29 17:01:22,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 17:01:22,084 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:22,084 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:22,084 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:22,084 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:22,084 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:01:22,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:22,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:22,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:22,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:22,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 656 msec 2023-09-29 17:01:22,464 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:01:22,464 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-29 17:01:22,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:01:22,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-29 17:01:22,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-29 17:01:22,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-29 17:01:22,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:01:22,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-29 17:01:22,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-29 17:01:22,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-29 17:01:22,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 17:01:22,559 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-29 17:01:22,563 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-29 17:01:22,564 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:22,566 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:01:22,590 DEBUG [hconnection-0x1eb93e1b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:22,595 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:22,599 DEBUG [hconnection-0x1eb93e1b-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:22,603 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:22,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 17:01:22,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006882618 (current time:1696006882618). 2023-09-29 17:01:22,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:01:22,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x48195743 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:22,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740a8acf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:22,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:22,633 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:22,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48195743 to 127.0.0.1:64917 2023-09-29 17:01:22,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:22,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x63ab315e to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:22,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3b4c7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:22,649 DEBUG [hconnection-0x3da6018c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:22,652 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:22,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63ab315e to 127.0.0.1:64917 2023-09-29 17:01:22,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:22,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-29 17:01:22,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:01:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 17:01:22,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 17:01:22,714 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 17:01:22,715 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696007482715 2023-09-29 17:01:22,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 17:01:22,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-29 17:01:22,719 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 17:01:22,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 17:01:22,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-09-29 17:01:22,723 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 17:01:22,725 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696007482725 2023-09-29 17:01:22,725 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:01:22,725 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:01:22,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,751 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-29 17:01:22,751 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:22,752 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-29 17:01:22,752 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-29 17:01:22,753 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,753 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,759 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:22,759 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:22,759 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:22,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:22,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:22,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:22,759 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,760 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,760 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,761 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-29 17:01:22,761 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-29 17:01:22,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 17:01:22,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 17:01:22,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 17:01:22,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,776 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 17:01:22,776 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:22,776 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 17:01:22,778 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 17:01:22,776 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 17:01:22,778 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-29 17:01:22,778 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:22,778 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:22,779 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 17:01:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 17:01:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-29 17:01:22,778 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-29 17:01:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-29 17:01:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-29 17:01:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-29 17:01:22,783 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,783 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,783 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:22,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:22,784 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,784 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:22,784 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,784 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,784 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:22,784 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:22,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-29 17:01:22,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46753729[Count = 1] remaining members to acquire global barrier 2023-09-29 17:01:22,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:22,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:22,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-29 17:01:22,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46753729[Count = 0] remaining members to acquire global barrier 2023-09-29 17:01:22,792 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-29 17:01:22,792 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,795 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 17:01:22,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-29 17:01:22,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:01:22,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,795 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,795 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 17:01:22,795 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:01:22,795 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 17:01:22,797 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:22,797 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:22,797 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:22,797 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. started... 2023-09-29 17:01:22,799 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:22,799 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:22,799 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:22,799 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 17:01:22,799 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. started... 2023-09-29 17:01:22,800 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:22,800 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-29 17:01:22,802 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79bb5163b89551ede8a56945cc14ccdc: 2023-09-29 17:01:22,802 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02acd33601a0a291990c133f4dcd1033: 2023-09-29 17:01:22,803 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,803 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,809 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:22,809 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:22,813 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:01:22,813 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:01:22,826 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:22,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 17:01:22,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:22,841 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:01:22,849 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. completed. 2023-09-29 17:01:22,849 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:22,850 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:22,850 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:22,850 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,850 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-29 17:01:22,850 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:01:22,852 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 17:01:22,852 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,852 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:22,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,852 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-29 17:01:22,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:22,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44811,1696006873656': 2023-09-29 17:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-29 17:01:23,045 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:23,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 17:01:23,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:23,047 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-29 17:01:23,250 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. completed. 2023-09-29 17:01:23,250 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:23,250 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:23,250 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:23,250 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,250 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-29 17:01:23,250 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:01:23,252 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 17:01:23,252 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,252 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,252 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-29 17:01:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:01:23,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-29 17:01:23,259 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-29 17:01:23,259 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:01:23,259 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:01:23,259 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,259 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:01:23,262 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:23,262 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:23,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:23,263 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:23,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:23,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,264 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,265 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,267 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:23,267 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,268 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:23,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:23,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,283 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:23,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-29 17:01:23,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:23,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:23,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:23,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:01:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:23,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,285 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,285 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,285 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,285 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,285 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:23,285 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:23,286 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,286 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,286 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 17:01:23,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,347 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:23,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 17:01:23,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:23,349 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-29 17:01:23,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-29 17:01:23,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,369 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:23,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696006882715Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696006883306 (+591 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696006883306Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696006883307 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696006883323 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696006883354 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696006883367 (+13 ms) 2023-09-29 17:01:23,371 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 17:01:23,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 653 msec 2023-09-29 17:01:23,849 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:23,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 17:01:23,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:01:23,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45619] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:01:23,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44811] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:01:23,873 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-29 17:01:23,873 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:23,874 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:01:23,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 17:01:23,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006883890 (current time:1696006883890). 2023-09-29 17:01:23,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:01:23,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x4ceb0607 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:23,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c7f4f38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:23,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:23,903 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:23,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ceb0607 to 127.0.0.1:64917 2023-09-29 17:01:23,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:23,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x6089d7d7 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:23,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74c63eff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:23,916 DEBUG [hconnection-0x12a6a9d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:23,919 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:23,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6089d7d7 to 127.0.0.1:64917 2023-09-29 17:01:23,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:23,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-29 17:01:23,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:01:23,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 17:01:23,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 17:01:23,931 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 17:01:23,932 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696007483932 2023-09-29 17:01:23,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 17:01:23,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-29 17:01:23,934 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:01:23,934 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:01:23,936 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 17:01:23,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 17:01:23,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-09-29 17:01:23,939 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 17:01:23,939 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696007483939 2023-09-29 17:01:23,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-29 17:01:23,957 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-29 17:01:23,957 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:23,958 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-29 17:01:23,958 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-29 17:01:23,959 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,959 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,960 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:23,960 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:23,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:23,960 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,960 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:23,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:23,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:23,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:23,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:23,961 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,961 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,961 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,961 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 17:01:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 17:01:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:23,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 17:01:23,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-29 17:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 17:01:23,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-29 17:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 17:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 17:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-29 17:01:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 17:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-29 17:01:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 17:01:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-29 17:01:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-29 17:01:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-29 17:01:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-29 17:01:23,969 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,969 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:23,969 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,969 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,969 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:23,969 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:23,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-29 17:01:23,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0692e6[Count = 1] remaining members to acquire global barrier 2023-09-29 17:01:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:23,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-29 17:01:23,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0692e6[Count = 0] remaining members to acquire global barrier 2023-09-29 17:01:23,975 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-29 17:01:23,975 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,979 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,979 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,979 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 17:01:23,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,980 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:23,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:23,980 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 17:01:23,980 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. started... 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-29 17:01:23,980 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:23,980 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:23,980 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:01:23,981 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79bb5163b89551ede8a56945cc14ccdc 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-29 17:01:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:01:23,981 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. started... 2023-09-29 17:01:23,981 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02acd33601a0a291990c133f4dcd1033 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-29 17:01:23,984 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 17:01:23,984 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:23,984 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-29 17:01:24,034 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:24,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 17:01:24,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:24,036 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:01:24,133 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230929a0d5c8999cbf480eacf957db96a4805b to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230929a0d5c8999cbf480eacf957db96a4805b 2023-09-29 17:01:24,133 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309295cd3cecac27d417481ac9c2631830de6 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309295cd3cecac27d417481ac9c2631830de6 2023-09-29 17:01:24,173 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/.tmp/cf/62400fd6399b4dceb3c7a70b833ce6c3 2023-09-29 17:01:24,173 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/.tmp/cf/bf8c5494201b4acaa8751e3a49408852 2023-09-29 17:01:24,185 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/.tmp/cf/62400fd6399b4dceb3c7a70b833ce6c3 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf/62400fd6399b4dceb3c7a70b833ce6c3 2023-09-29 17:01:24,185 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/.tmp/cf/bf8c5494201b4acaa8751e3a49408852 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf/bf8c5494201b4acaa8751e3a49408852 2023-09-29 17:01:24,194 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf/bf8c5494201b4acaa8751e3a49408852, entries=47, sequenceid=6, filesize=12.8 K 2023-09-29 17:01:24,194 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf/62400fd6399b4dceb3c7a70b833ce6c3, entries=3, sequenceid=6, filesize=5.4 K 2023-09-29 17:01:24,200 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 79bb5163b89551ede8a56945cc14ccdc in 220ms, sequenceid=6, compaction requested=false 2023-09-29 17:01:24,201 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-29 17:01:24,202 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79bb5163b89551ede8a56945cc14ccdc: 2023-09-29 17:01:24,202 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 02acd33601a0a291990c133f4dcd1033 in 221ms, sequenceid=6, compaction requested=false 2023-09-29 17:01:24,203 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02acd33601a0a291990c133f4dcd1033: 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf/62400fd6399b4dceb3c7a70b833ce6c3] hfiles 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf/bf8c5494201b4acaa8751e3a49408852] hfiles 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf/62400fd6399b4dceb3c7a70b833ce6c3 for snapshot=snaptb0-testExportWithTargetName 2023-09-29 17:01:24,204 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf/bf8c5494201b4acaa8751e3a49408852 for snapshot=snaptb0-testExportWithTargetName 2023-09-29 17:01:24,230 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. completed. 2023-09-29 17:01:24,230 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. completed. 2023-09-29 17:01:24,230 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:24,230 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:24,230 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:24,230 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:24,230 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,230 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-29 17:01:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-29 17:01:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:01:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:01:24,233 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,233 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 17:01:24,233 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 17:01:24,233 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,233 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:24,233 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:24,233 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-29 17:01:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:24,234 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-29 17:01:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:24,236 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:24,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 17:01:24,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:24,238 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-29 17:01:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:24,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:01:24,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-29 17:01:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:24,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:24,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44811,1696006873656': 2023-09-29 17:01:24,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-29 17:01:24,248 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-29 17:01:24,248 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:01:24,248 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:01:24,248 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-29 17:01:24,248 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:01:24,251 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:24,251 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:24,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,253 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:24,253 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:24,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:24,255 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 17:01:24,256 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,256 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,269 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,269 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:24,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-29 17:01:24,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:24,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:24,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,269 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:24,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:24,270 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:24,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:24,269 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:24,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:24,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:24,271 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,271 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:24,271 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:24,271 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,271 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:24,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230929a0d5c8999cbf480eacf957db96a4805b, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309295cd3cecac27d417481ac9c2631830de6] mob files 2023-09-29 17:01:24,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230929a0d5c8999cbf480eacf957db96a4805b 2023-09-29 17:01:24,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309295cd3cecac27d417481ac9c2631830de6 2023-09-29 17:01:24,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-29 17:01:24,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-29 17:01:24,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,333 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-29 17:01:24,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696006883932Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696006884291 (+359 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696006884291Loading Region manifests for snaptb0-testExportWithTargetName at 1696006884291Writing data manifest for snaptb0-testExportWithTargetName at 1696006884296 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696006884320 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696006884333 (+13 ms) 2023-09-29 17:01:24,336 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 17:01:24,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 403 msec 2023-09-29 17:01:24,539 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:24,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 17:01:24,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:01:24,542 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542 2023-09-29 17:01:24,543 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39529, tgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542, rawTgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542, srcFsUri=hdfs://localhost:39529, srcDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:24,580 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:24,580 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1207637042_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-29 17:01:24,580 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, snapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-29 17:01:24,601 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-29 17:01:24,685 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:24,686 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:24,686 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:24,687 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,611 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-6218808427818865834.jar 2023-09-29 17:01:25,612 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,612 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,680 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-8807014348803557899.jar 2023-09-29 17:01:25,681 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,682 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,682 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,683 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,683 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,683 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:25,684 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 17:01:25,685 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 17:01:25,685 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 17:01:25,686 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 17:01:25,687 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 17:01:25,688 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 17:01:25,688 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 17:01:25,689 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 17:01:25,690 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 17:01:25,691 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 17:01:25,696 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:25,697 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:25,697 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:25,698 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:25,698 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:25,699 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:25,700 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:26,533 WARN [Listener at jenkins-hbase4.apache.org/46659] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 17:01:26,539 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-29 17:01:26,548 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-29 17:01:27,043 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:01:27,046 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:01:27,455 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:01:27,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0001_000001 (auth:SIMPLE) 2023-09-29 17:01:31,917 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0001_000001 (auth:SIMPLE) 2023-09-29 17:01:34,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0001_000001 (auth:SIMPLE) 2023-09-29 17:01:37,570 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0001_000001 (auth:SIMPLE) 2023-09-29 17:01:39,413 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 17:01:39,417 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 17:01:39,430 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-29 17:01:39,430 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 17:01:39,431 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 17:01:39,431 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-29 17:01:39,432 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-29 17:01:39,432 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-29 17:01:39,432 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542/.hbase-snapshot/testExportWithTargetName 2023-09-29 17:01:39,433 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-29 17:01:39,433 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006884542/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-29 17:01:39,444 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-29 17:01:39,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-29 17:01:39,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:39,464 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006899463"}]},"ts":"1696006899463"} 2023-09-29 17:01:39,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-29 17:01:39,466 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-29 17:01:39,468 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-29 17:01:39,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02acd33601a0a291990c133f4dcd1033, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79bb5163b89551ede8a56945cc14ccdc, UNASSIGN}] 2023-09-29 17:01:39,472 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02acd33601a0a291990c133f4dcd1033, UNASSIGN 2023-09-29 17:01:39,472 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79bb5163b89551ede8a56945cc14ccdc, UNASSIGN 2023-09-29 17:01:39,473 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=02acd33601a0a291990c133f4dcd1033, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:39,473 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=79bb5163b89551ede8a56945cc14ccdc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:39,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006899473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006899473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006899473"}]},"ts":"1696006899473"} 2023-09-29 17:01:39,474 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006899473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006899473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006899473"}]},"ts":"1696006899473"} 2023-09-29 17:01:39,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 79bb5163b89551ede8a56945cc14ccdc, server=jenkins-hbase4.apache.org,44811,1696006873656}] 2023-09-29 17:01:39,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 02acd33601a0a291990c133f4dcd1033, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:01:39,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-29 17:01:39,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:39,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79bb5163b89551ede8a56945cc14ccdc, disabling compactions & flushes 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02acd33601a0a291990c133f4dcd1033, disabling compactions & flushes 2023-09-29 17:01:39,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:39,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. after waiting 0 ms 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. after waiting 0 ms 2023-09-29 17:01:39,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:39,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:01:39,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:01:39,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:01:39,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:01:39,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc. 2023-09-29 17:01:39,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033. 2023-09-29 17:01:39,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79bb5163b89551ede8a56945cc14ccdc: 2023-09-29 17:01:39,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02acd33601a0a291990c133f4dcd1033: 2023-09-29 17:01:39,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:39,659 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=02acd33601a0a291990c133f4dcd1033, regionState=CLOSED 2023-09-29 17:01:39,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:39,659 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006899659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006899659"}]},"ts":"1696006899659"} 2023-09-29 17:01:39,660 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=79bb5163b89551ede8a56945cc14ccdc, regionState=CLOSED 2023-09-29 17:01:39,660 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696006899660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006899660"}]},"ts":"1696006899660"} 2023-09-29 17:01:39,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-29 17:01:39,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 02acd33601a0a291990c133f4dcd1033, server=jenkins-hbase4.apache.org,45619,1696006873557 in 184 msec 2023-09-29 17:01:39,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-29 17:01:39,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 79bb5163b89551ede8a56945cc14ccdc, server=jenkins-hbase4.apache.org,44811,1696006873656 in 186 msec 2023-09-29 17:01:39,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02acd33601a0a291990c133f4dcd1033, UNASSIGN in 194 msec 2023-09-29 17:01:39,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-29 17:01:39,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79bb5163b89551ede8a56945cc14ccdc, UNASSIGN in 195 msec 2023-09-29 17:01:39,669 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006899669"}]},"ts":"1696006899669"} 2023-09-29 17:01:39,671 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-29 17:01:39,673 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-29 17:01:39,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-09-29 17:01:39,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-29 17:01:39,768 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-29 17:01:39,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-29 17:01:39,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:39,783 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:39,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-29 17:01:39,786 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:39,788 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-29 17:01:39,792 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:39,793 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,793 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:39,793 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,793 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,793 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-29 17:01:39,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-29 17:01:39,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-29 17:01:39,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-29 17:01:39,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:39,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:39,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:39,796 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 17:01:39,796 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:39,798 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/recovered.edits] 2023-09-29 17:01:39,798 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/recovered.edits] 2023-09-29 17:01:39,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-29 17:01:39,806 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf/62400fd6399b4dceb3c7a70b833ce6c3 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/cf/62400fd6399b4dceb3c7a70b833ce6c3 2023-09-29 17:01:39,806 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf/bf8c5494201b4acaa8751e3a49408852 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/cf/bf8c5494201b4acaa8751e3a49408852 2023-09-29 17:01:39,810 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033/recovered.edits/9.seqid 2023-09-29 17:01:39,811 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc/recovered.edits/9.seqid 2023-09-29 17:01:39,811 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/02acd33601a0a291990c133f4dcd1033 2023-09-29 17:01:39,811 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportWithTargetName/79bb5163b89551ede8a56945cc14ccdc 2023-09-29 17:01:39,811 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-29 17:01:39,812 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-29 17:01:39,813 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-29 17:01:39,817 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230929a0d5c8999cbf480eacf957db96a4805b to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230929a0d5c8999cbf480eacf957db96a4805b 2023-09-29 17:01:39,818 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309295cd3cecac27d417481ac9c2631830de6 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309295cd3cecac27d417481ac9c2631830de6 2023-09-29 17:01:39,819 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-29 17:01:39,822 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:39,853 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-29 17:01:39,856 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-29 17:01:39,858 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:39,858 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-29 17:01:39,858 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006899858"}]},"ts":"9223372036854775807"} 2023-09-29 17:01:39,858 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006899858"}]},"ts":"9223372036854775807"} 2023-09-29 17:01:39,860 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 17:01:39,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 02acd33601a0a291990c133f4dcd1033, NAME => 'testtb-testExportWithTargetName,,1696006881436.02acd33601a0a291990c133f4dcd1033.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 79bb5163b89551ede8a56945cc14ccdc, NAME => 'testtb-testExportWithTargetName,1,1696006881436.79bb5163b89551ede8a56945cc14ccdc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 17:01:39,861 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-29 17:01:39,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696006899861"}]},"ts":"9223372036854775807"} 2023-09-29 17:01:39,863 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-29 17:01:39,865 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 17:01:39,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-09-29 17:01:39,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-29 17:01:39,903 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-29 17:01:39,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-29 17:01:39,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-29 17:01:39,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-29 17:01:39,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-29 17:01:39,962 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 704) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:37235 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:39821 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:35111 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-389527103_1 at /127.0.0.1:46070 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:35788 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:46628 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:46114 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 165) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1099 (was 1925) 2023-09-29 17:01:39,962 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-29 17:01:39,982 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=193, ProcessCount=168, AvailableMemoryMB=1098 2023-09-29 17:01:39,982 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-29 17:01:39,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 17:01:39,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:39,991 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:01:39,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-29 17:01:39,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 17:01:39,993 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:01:39,997 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:39,997 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:39,997 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57 empty. 2023-09-29 17:01:39,997 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5 empty. 2023-09-29 17:01:39,998 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:39,998 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:39,998 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-29 17:01:40,011 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-29 17:01:40,013 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7c59549464ae9f2a3bfa3d485d2fa8e5, NAME => 'testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:40,013 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2a6ec1dd0b0d5af1a8a38c8164f81a57, NAME => 'testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:40,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:40,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7c59549464ae9f2a3bfa3d485d2fa8e5, disabling compactions & flushes 2023-09-29 17:01:40,041 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. after waiting 0 ms 2023-09-29 17:01:40,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,042 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7c59549464ae9f2a3bfa3d485d2fa8e5: 2023-09-29 17:01:40,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:40,043 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2a6ec1dd0b0d5af1a8a38c8164f81a57, disabling compactions & flushes 2023-09-29 17:01:40,043 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,043 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,043 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. after waiting 0 ms 2023-09-29 17:01:40,043 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,043 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,043 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2a6ec1dd0b0d5af1a8a38c8164f81a57: 2023-09-29 17:01:40,046 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:01:40,048 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006900047"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006900047"}]},"ts":"1696006900047"} 2023-09-29 17:01:40,048 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006900047"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006900047"}]},"ts":"1696006900047"} 2023-09-29 17:01:40,051 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 17:01:40,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:01:40,055 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006900055"}]},"ts":"1696006900055"} 2023-09-29 17:01:40,057 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-29 17:01:40,061 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:01:40,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:01:40,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:01:40,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:01:40,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:01:40,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a6ec1dd0b0d5af1a8a38c8164f81a57, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c59549464ae9f2a3bfa3d485d2fa8e5, ASSIGN}] 2023-09-29 17:01:40,066 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c59549464ae9f2a3bfa3d485d2fa8e5, ASSIGN 2023-09-29 17:01:40,066 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a6ec1dd0b0d5af1a8a38c8164f81a57, ASSIGN 2023-09-29 17:01:40,068 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c59549464ae9f2a3bfa3d485d2fa8e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44759,1696006873606; forceNewPlan=false, retain=false 2023-09-29 17:01:40,068 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a6ec1dd0b0d5af1a8a38c8164f81a57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44811,1696006873656; forceNewPlan=false, retain=false 2023-09-29 17:01:40,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 17:01:40,218 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 17:01:40,221 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7c59549464ae9f2a3bfa3d485d2fa8e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,221 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2a6ec1dd0b0d5af1a8a38c8164f81a57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,222 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006900221"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006900221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006900221"}]},"ts":"1696006900221"} 2023-09-29 17:01:40,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006900221"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006900221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006900221"}]},"ts":"1696006900221"} 2023-09-29 17:01:40,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 7c59549464ae9f2a3bfa3d485d2fa8e5, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:01:40,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 2a6ec1dd0b0d5af1a8a38c8164f81a57, server=jenkins-hbase4.apache.org,44811,1696006873656}] 2023-09-29 17:01:40,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 17:01:40,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a6ec1dd0b0d5af1a8a38c8164f81a57, NAME => 'testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c59549464ae9f2a3bfa3d485d2fa8e5, NAME => 'testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. service=AccessControlService 2023-09-29 17:01:40,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. service=AccessControlService 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:40,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:40,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:40,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:40,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:40,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:40,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:40,391 INFO [StoreOpener-2a6ec1dd0b0d5af1a8a38c8164f81a57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:40,392 INFO [StoreOpener-7c59549464ae9f2a3bfa3d485d2fa8e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:40,393 DEBUG [StoreOpener-2a6ec1dd0b0d5af1a8a38c8164f81a57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf 2023-09-29 17:01:40,393 DEBUG [StoreOpener-2a6ec1dd0b0d5af1a8a38c8164f81a57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf 2023-09-29 17:01:40,393 DEBUG [StoreOpener-7c59549464ae9f2a3bfa3d485d2fa8e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf 2023-09-29 17:01:40,393 DEBUG [StoreOpener-7c59549464ae9f2a3bfa3d485d2fa8e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf 2023-09-29 17:01:40,394 INFO [StoreOpener-2a6ec1dd0b0d5af1a8a38c8164f81a57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a6ec1dd0b0d5af1a8a38c8164f81a57 columnFamilyName cf 2023-09-29 17:01:40,394 INFO [StoreOpener-7c59549464ae9f2a3bfa3d485d2fa8e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c59549464ae9f2a3bfa3d485d2fa8e5 columnFamilyName cf 2023-09-29 17:01:40,395 INFO [StoreOpener-7c59549464ae9f2a3bfa3d485d2fa8e5-1] regionserver.HStore(310): Store=7c59549464ae9f2a3bfa3d485d2fa8e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:40,395 INFO [StoreOpener-2a6ec1dd0b0d5af1a8a38c8164f81a57-1] regionserver.HStore(310): Store=2a6ec1dd0b0d5af1a8a38c8164f81a57/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:40,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:40,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:40,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:40,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:40,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:40,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:40,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:40,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:40,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a6ec1dd0b0d5af1a8a38c8164f81a57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69501915, jitterRate=0.03565923869609833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:40,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c59549464ae9f2a3bfa3d485d2fa8e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64707548, jitterRate=-0.03578239679336548}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:40,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a6ec1dd0b0d5af1a8a38c8164f81a57: 2023-09-29 17:01:40,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c59549464ae9f2a3bfa3d485d2fa8e5: 2023-09-29 17:01:40,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57., pid=31, masterSystemTime=1696006900380 2023-09-29 17:01:40,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5., pid=30, masterSystemTime=1696006900377 2023-09-29 17:01:40,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7c59549464ae9f2a3bfa3d485d2fa8e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,411 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006900410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006900410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006900410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006900410"}]},"ts":"1696006900410"} 2023-09-29 17:01:40,411 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2a6ec1dd0b0d5af1a8a38c8164f81a57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,411 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006900411"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006900411"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006900411"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006900411"}]},"ts":"1696006900411"} 2023-09-29 17:01:40,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-29 17:01:40,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 7c59549464ae9f2a3bfa3d485d2fa8e5, server=jenkins-hbase4.apache.org,44759,1696006873606 in 188 msec 2023-09-29 17:01:40,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-29 17:01:40,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c59549464ae9f2a3bfa3d485d2fa8e5, ASSIGN in 356 msec 2023-09-29 17:01:40,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 2a6ec1dd0b0d5af1a8a38c8164f81a57, server=jenkins-hbase4.apache.org,44811,1696006873656 in 191 msec 2023-09-29 17:01:40,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-29 17:01:40,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a6ec1dd0b0d5af1a8a38c8164f81a57, ASSIGN in 360 msec 2023-09-29 17:01:40,427 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:01:40,427 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006900427"}]},"ts":"1696006900427"} 2023-09-29 17:01:40,430 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-29 17:01:40,433 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:01:40,433 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-29 17:01:40,436 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 17:01:40,437 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:40,437 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:40,437 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:40,438 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:40,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:40,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:40,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:40,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:40,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 453 msec 2023-09-29 17:01:40,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 17:01:40,598 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-29 17:01:40,602 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-29 17:01:40,602 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,605 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:01:40,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:01:40,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006900624 (current time:1696006900624). 2023-09-29 17:01:40,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:01:40,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x794ab05d to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:40,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41c3f838, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:40,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:40,640 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:40,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x794ab05d to 127.0.0.1:64917 2023-09-29 17:01:40,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:40,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x4f887769 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:40,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63ecee9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:40,652 DEBUG [hconnection-0x3db0c8e0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:40,653 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:40,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f887769 to 127.0.0.1:64917 2023-09-29 17:01:40,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:40,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 17:01:40,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:01:40,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:01:40,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:01:40,670 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:01:40,672 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696007500672 2023-09-29 17:01:40,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-29 17:01:40,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:01:40,674 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:01:40,674 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:01:40,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 17:01:40,677 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:01:40,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-09-29 17:01:40,681 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 17:01:40,683 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696007500683 2023-09-29 17:01:40,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,706 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-29 17:01:40,706 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:40,707 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-29 17:01:40,707 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-29 17:01:40,708 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,708 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,710 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:40,710 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:40,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:40,710 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:40,710 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:40,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,711 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,711 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,712 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,712 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 17:01:40,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,713 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 17:01:40,713 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:40,713 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 17:01:40,713 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 17:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-29 17:01:40,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 17:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 17:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-29 17:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-29 17:01:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-29 17:01:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 17:01:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-29 17:01:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-29 17:01:40,726 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,726 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,726 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:40,727 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,728 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:40,728 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,728 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:40,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-29 17:01:40,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a51a325[Count = 1] remaining members to acquire global barrier 2023-09-29 17:01:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:40,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-29 17:01:40,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a51a325[Count = 0] remaining members to acquire global barrier 2023-09-29 17:01:40,733 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 17:01:40,733 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:01:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:01:40,736 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,736 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,736 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. started... 2023-09-29 17:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:40,737 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:01:40,737 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a6ec1dd0b0d5af1a8a38c8164f81a57: 2023-09-29 17:01:40,737 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. started... 2023-09-29 17:01:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:40,736 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:01:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-29 17:01:40,738 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c59549464ae9f2a3bfa3d485d2fa8e5: 2023-09-29 17:01:40,738 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,738 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:01:40,739 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:40,739 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,739 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:01:40,739 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:40,739 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:01:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 17:01:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-29 17:01:40,761 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. completed. 2023-09-29 17:01:40,762 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,762 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:40,764 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:40,764 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-29 17:01:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:01:40,766 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. completed. 2023-09-29 17:01:40,766 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-29 17:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:01:40,767 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 17:01:40,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:40,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:40,768 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-29 17:01:40,770 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,770 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 17:01:40,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:40,770 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:40,770 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-29 17:01:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,774 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:40,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44811,1696006873656': 2023-09-29 17:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 17:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:40,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:01:40,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:40,775 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:01:40,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:01:40,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 17:01:40,780 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-29 17:01:40,780 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:01:40,780 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:01:40,780 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,780 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:01:40,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:40,783 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:40,784 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:40,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:40,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:40,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,785 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,787 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:40,790 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,790 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,791 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:40,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:40,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:40,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,795 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:40,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:40,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:40,795 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-29 17:01:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:40,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:01:40,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,798 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 17:01:40,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-29 17:01:40,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,849 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:40,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696006900672Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696006900820 (+148 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696006900820Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696006900820Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696006900824 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696006900838 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696006900849 (+11 ms) 2023-09-29 17:01:40,852 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 17:01:40,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 179 msec 2023-09-29 17:01:40,976 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:40,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:01:40,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:01:40,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44811] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:01:40,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44759] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:01:40,989 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-29 17:01:40,989 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:40,990 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:01:41,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:01:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006901004 (current time:1696006901004). 2023-09-29 17:01:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:01:41,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x2c908890 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:41,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab92cf5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:41,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:41,017 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:41,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c908890 to 127.0.0.1:64917 2023-09-29 17:01:41,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:41,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x2aa25151 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:41,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@183c2b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:41,028 DEBUG [hconnection-0x6d40a4f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:41,031 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:41,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2aa25151 to 127.0.0.1:64917 2023-09-29 17:01:41,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:41,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 17:01:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:01:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:01:41,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:01:41,041 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:01:41,042 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696007501042 2023-09-29 17:01:41,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-29 17:01:41,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:01:41,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 17:01:41,046 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:01:41,046 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:01:41,046 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:01:41,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-29 17:01:41,049 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 17:01:41,050 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696007501050 2023-09-29 17:01:41,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-29 17:01:41,065 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-29 17:01:41,065 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:41,067 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-29 17:01:41,067 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-29 17:01:41,068 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,068 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,070 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:41,070 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:41,070 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:41,070 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:41,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:41,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,070 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,071 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,071 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,071 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:01:41,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 17:01:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 17:01:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:41,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 17:01:41,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-29 17:01:41,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-29 17:01:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 17:01:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 17:01:41,075 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 17:01:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 17:01:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-29 17:01:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-29 17:01:41,077 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 17:01:41,077 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-29 17:01:41,077 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-29 17:01:41,077 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-29 17:01:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-29 17:01:41,079 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,079 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:41,080 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,080 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:41,080 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707a992b[Count = 1] remaining members to acquire global barrier 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:41,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-29 17:01:41,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707a992b[Count = 0] remaining members to acquire global barrier 2023-09-29 17:01:41,085 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 17:01:41,085 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,086 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:01:41,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-29 17:01:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:01:41,087 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,087 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:41,087 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:41,087 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:41,088 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. started... 2023-09-29 17:01:41,088 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. started... 2023-09-29 17:01:41,088 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2a6ec1dd0b0d5af1a8a38c8164f81a57 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-29 17:01:41,088 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7c59549464ae9f2a3bfa3d485d2fa8e5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-29 17:01:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 17:01:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-29 17:01:41,119 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092935e59bd0641e4c55ad5b0c42f1257a2d to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092935e59bd0641e4c55ad5b0c42f1257a2d 2023-09-29 17:01:41,119 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230929540d4b2b581847f986e5b846a9cd6c53 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929540d4b2b581847f986e5b846a9cd6c53 2023-09-29 17:01:41,134 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/.tmp/cf/7b6cda52950b4b208bad38fc8c100a12 2023-09-29 17:01:41,137 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/.tmp/cf/184dc43a3a0249cfb9351596f73d4036 2023-09-29 17:01:41,145 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/.tmp/cf/7b6cda52950b4b208bad38fc8c100a12 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf/7b6cda52950b4b208bad38fc8c100a12 2023-09-29 17:01:41,146 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:41,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:01:41,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:41,148 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:01:41,148 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/.tmp/cf/184dc43a3a0249cfb9351596f73d4036 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf/184dc43a3a0249cfb9351596f73d4036 2023-09-29 17:01:41,151 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf/7b6cda52950b4b208bad38fc8c100a12, entries=4, sequenceid=6, filesize=5.6 K 2023-09-29 17:01:41,154 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 2a6ec1dd0b0d5af1a8a38c8164f81a57 in 66ms, sequenceid=6, compaction requested=false 2023-09-29 17:01:41,154 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-29 17:01:41,154 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf/184dc43a3a0249cfb9351596f73d4036, entries=46, sequenceid=6, filesize=12.7 K 2023-09-29 17:01:41,154 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a6ec1dd0b0d5af1a8a38c8164f81a57: 2023-09-29 17:01:41,155 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-29 17:01:41,155 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:41,155 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf/7b6cda52950b4b208bad38fc8c100a12] hfiles 2023-09-29 17:01:41,155 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf/7b6cda52950b4b208bad38fc8c100a12 for snapshot=snaptb0-testExportFileSystemState 2023-09-29 17:01:41,155 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 7c59549464ae9f2a3bfa3d485d2fa8e5 in 67ms, sequenceid=6, compaction requested=false 2023-09-29 17:01:41,157 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c59549464ae9f2a3bfa3d485d2fa8e5: 2023-09-29 17:01:41,157 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-29 17:01:41,157 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:41,157 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf/184dc43a3a0249cfb9351596f73d4036] hfiles 2023-09-29 17:01:41,157 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf/184dc43a3a0249cfb9351596f73d4036 for snapshot=snaptb0-testExportFileSystemState 2023-09-29 17:01:41,172 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. completed. 2023-09-29 17:01:41,172 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-29 17:01:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:01:41,173 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. completed. 2023-09-29 17:01:41,173 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:41,173 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:41,173 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:41,173 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,173 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-29 17:01:41,173 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:01:41,178 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 17:01:41,178 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,178 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:41,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:41,178 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-29 17:01:41,181 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,181 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 17:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:41,181 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:41,181 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-29 17:01:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:01:41,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 17:01:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44811,1696006873656': 2023-09-29 17:01:41,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 17:01:41,190 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-29 17:01:41,190 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:01:41,190 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:01:41,190 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-29 17:01:41,190 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:01:41,192 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:41,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:41,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,192 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:41,192 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:41,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:41,192 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,193 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:41,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:41,194 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:41,196 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 17:01:41,196 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,196 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,199 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,199 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:41,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:41,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-29 17:01:41,200 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:41,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-29 17:01:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:41,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:41,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:01:41,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:41,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:41,202 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:41,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:41,202 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,203 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:41,203 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:41,203 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,203 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:41,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092935e59bd0641e4c55ad5b0c42f1257a2d, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929540d4b2b581847f986e5b846a9cd6c53] mob files 2023-09-29 17:01:41,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092935e59bd0641e4c55ad5b0c42f1257a2d 2023-09-29 17:01:41,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929540d4b2b581847f986e5b846a9cd6c53 2023-09-29 17:01:41,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-29 17:01:41,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-29 17:01:41,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,240 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696006901042Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696006901213 (+171 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696006901213Loading Region manifests for snaptb0-testExportFileSystemState at 1696006901213Writing data manifest for snaptb0-testExportFileSystemState at 1696006901217 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696006901230 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696006901239 (+9 ms) 2023-09-29 17:01:41,243 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 17:01:41,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 200 msec 2023-09-29 17:01:41,348 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:41,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:01:41,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:01:41,350 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350 2023-09-29 17:01:41,350 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39529, tgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350, rawTgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350, srcFsUri=hdfs://localhost:39529, srcDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:41,373 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:41,373 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_5204186_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,373 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, snapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-29 17:01:41,389 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 17:01:41,422 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:41,422 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:41,423 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:41,424 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,319 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-8676691444144793685.jar 2023-09-29 17:01:42,320 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,320 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,393 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-8642216180767348644.jar 2023-09-29 17:01:42,393 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,394 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,394 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 17:01:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 17:01:42,397 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 17:01:42,397 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 17:01:42,397 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 17:01:42,398 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 17:01:42,398 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 17:01:42,398 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 17:01:42,399 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 17:01:42,399 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 17:01:42,400 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:42,400 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:42,401 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:42,401 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:42,401 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:42,402 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:42,403 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:42,908 WARN [Listener at jenkins-hbase4.apache.org/46659] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 17:01:42,911 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-29 17:01:42,914 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-29 17:01:43,772 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:01:43,772 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:01:43,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0001_000001 (auth:SIMPLE) 2023-09-29 17:01:44,538 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0002_000001 (auth:SIMPLE) 2023-09-29 17:01:45,260 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:01:48,788 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0002_000001 (auth:SIMPLE) 2023-09-29 17:01:51,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0002_000001 (auth:SIMPLE) 2023-09-29 17:01:53,658 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0002_000001 (auth:SIMPLE) 2023-09-29 17:01:55,110 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 17:01:55,111 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 17:01:55,119 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-29 17:01:55,119 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 17:01:55,120 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 17:01:55,120 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-29 17:01:55,120 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-29 17:01:55,121 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-29 17:01:55,121 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-29 17:01:55,121 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-29 17:01:55,121 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006901350/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-29 17:01:55,129 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-29 17:01:55,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-29 17:01:55,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:55,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-29 17:01:55,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006915135"}]},"ts":"1696006915135"} 2023-09-29 17:01:55,137 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-29 17:01:55,139 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-29 17:01:55,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a6ec1dd0b0d5af1a8a38c8164f81a57, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c59549464ae9f2a3bfa3d485d2fa8e5, UNASSIGN}] 2023-09-29 17:01:55,143 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a6ec1dd0b0d5af1a8a38c8164f81a57, UNASSIGN 2023-09-29 17:01:55,143 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c59549464ae9f2a3bfa3d485d2fa8e5, UNASSIGN 2023-09-29 17:01:55,144 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2a6ec1dd0b0d5af1a8a38c8164f81a57, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:55,144 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7c59549464ae9f2a3bfa3d485d2fa8e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:55,144 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006915144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006915144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006915144"}]},"ts":"1696006915144"} 2023-09-29 17:01:55,144 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006915144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006915144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006915144"}]},"ts":"1696006915144"} 2023-09-29 17:01:55,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 2a6ec1dd0b0d5af1a8a38c8164f81a57, server=jenkins-hbase4.apache.org,44811,1696006873656}] 2023-09-29 17:01:55,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 7c59549464ae9f2a3bfa3d485d2fa8e5, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:01:55,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-29 17:01:55,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:55,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a6ec1dd0b0d5af1a8a38c8164f81a57, disabling compactions & flushes 2023-09-29 17:01:55,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:55,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:55,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. after waiting 0 ms 2023-09-29 17:01:55,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:55,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:55,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c59549464ae9f2a3bfa3d485d2fa8e5, disabling compactions & flushes 2023-09-29 17:01:55,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:55,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:55,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. after waiting 0 ms 2023-09-29 17:01:55,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:55,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:01:55,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:01:55,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:01:55,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57. 2023-09-29 17:01:55,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a6ec1dd0b0d5af1a8a38c8164f81a57: 2023-09-29 17:01:55,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:01:55,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5. 2023-09-29 17:01:55,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c59549464ae9f2a3bfa3d485d2fa8e5: 2023-09-29 17:01:55,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:55,314 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2a6ec1dd0b0d5af1a8a38c8164f81a57, regionState=CLOSED 2023-09-29 17:01:55,314 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006915314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006915314"}]},"ts":"1696006915314"} 2023-09-29 17:01:55,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:55,315 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7c59549464ae9f2a3bfa3d485d2fa8e5, regionState=CLOSED 2023-09-29 17:01:55,315 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696006915315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006915315"}]},"ts":"1696006915315"} 2023-09-29 17:01:55,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-29 17:01:55,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 2a6ec1dd0b0d5af1a8a38c8164f81a57, server=jenkins-hbase4.apache.org,44811,1696006873656 in 170 msec 2023-09-29 17:01:55,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-29 17:01:55,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 7c59549464ae9f2a3bfa3d485d2fa8e5, server=jenkins-hbase4.apache.org,44759,1696006873606 in 170 msec 2023-09-29 17:01:55,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a6ec1dd0b0d5af1a8a38c8164f81a57, UNASSIGN in 178 msec 2023-09-29 17:01:55,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-29 17:01:55,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c59549464ae9f2a3bfa3d485d2fa8e5, UNASSIGN in 179 msec 2023-09-29 17:01:55,322 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006915321"}]},"ts":"1696006915321"} 2023-09-29 17:01:55,323 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-29 17:01:55,325 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-29 17:01:55,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 197 msec 2023-09-29 17:01:55,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-29 17:01:55,437 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-29 17:01:55,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-29 17:01:55,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:55,442 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:55,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-29 17:01:55,443 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:55,444 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-29 17:01:55,448 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 17:01:55,448 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 17:01:55,448 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:55,448 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 17:01:55,448 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 17:01:55,448 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:55,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-29 17:01:55,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-29 17:01:55,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-29 17:01:55,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 17:01:55,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 17:01:55,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:55,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-29 17:01:55,450 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 17:01:55,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 17:01:55,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:55,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:55,451 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:55,451 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/recovered.edits] 2023-09-29 17:01:55,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-29 17:01:55,452 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/recovered.edits] 2023-09-29 17:01:55,457 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf/184dc43a3a0249cfb9351596f73d4036 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/cf/184dc43a3a0249cfb9351596f73d4036 2023-09-29 17:01:55,457 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf/7b6cda52950b4b208bad38fc8c100a12 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/cf/7b6cda52950b4b208bad38fc8c100a12 2023-09-29 17:01:55,461 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5/recovered.edits/9.seqid 2023-09-29 17:01:55,461 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57/recovered.edits/9.seqid 2023-09-29 17:01:55,462 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/7c59549464ae9f2a3bfa3d485d2fa8e5 2023-09-29 17:01:55,462 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemState/2a6ec1dd0b0d5af1a8a38c8164f81a57 2023-09-29 17:01:55,462 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-29 17:01:55,462 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-29 17:01:55,463 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-29 17:01:55,467 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092935e59bd0641e4c55ad5b0c42f1257a2d to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092935e59bd0641e4c55ad5b0c42f1257a2d 2023-09-29 17:01:55,468 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929540d4b2b581847f986e5b846a9cd6c53 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929540d4b2b581847f986e5b846a9cd6c53 2023-09-29 17:01:55,469 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-29 17:01:55,472 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:55,475 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-29 17:01:55,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-29 17:01:55,479 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:55,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-29 17:01:55,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006915480"}]},"ts":"9223372036854775807"} 2023-09-29 17:01:55,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006915480"}]},"ts":"9223372036854775807"} 2023-09-29 17:01:55,482 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 17:01:55,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2a6ec1dd0b0d5af1a8a38c8164f81a57, NAME => 'testtb-testExportFileSystemState,,1696006899984.2a6ec1dd0b0d5af1a8a38c8164f81a57.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7c59549464ae9f2a3bfa3d485d2fa8e5, NAME => 'testtb-testExportFileSystemState,1,1696006899984.7c59549464ae9f2a3bfa3d485d2fa8e5.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 17:01:55,482 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-29 17:01:55,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696006915482"}]},"ts":"9223372036854775807"} 2023-09-29 17:01:55,484 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-29 17:01:55,486 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 17:01:55,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-09-29 17:01:55,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-29 17:01:55,553 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-29 17:01:55,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-29 17:01:55,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-29 17:01:55,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-29 17:01:55,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-29 17:01:55,599 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:55272 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_5204186_17 at /127.0.0.1:59976 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:44457 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-2082 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:48440 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1588030374_1 at /127.0.0.1:59958 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1588030374_1 at /127.0.0.1:55254 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 193) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1000 (was 1098) 2023-09-29 17:01:55,600 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-29 17:01:55,624 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=168, AvailableMemoryMB=1000 2023-09-29 17:01:55,624 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-29 17:01:55,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 17:01:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:01:55,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:01:55,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-29 17:01:55,633 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:01:55,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 17:01:55,636 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:55,636 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:55,637 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76 empty. 2023-09-29 17:01:55,637 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c empty. 2023-09-29 17:01:55,637 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:55,637 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:55,637 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-29 17:01:55,649 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-29 17:01:55,652 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 60f274477d727c3d1f1dbf06ab10da76, NAME => 'testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:55,652 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5bf82b3bbbe2e971c4c7e5257532d22c, NAME => 'testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:01:55,673 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:55,674 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5bf82b3bbbe2e971c4c7e5257532d22c, disabling compactions & flushes 2023-09-29 17:01:55,674 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:55,674 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:55,674 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. after waiting 0 ms 2023-09-29 17:01:55,674 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:55,674 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:55,674 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5bf82b3bbbe2e971c4c7e5257532d22c: 2023-09-29 17:01:55,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 17:01:55,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 17:01:56,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:56,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 60f274477d727c3d1f1dbf06ab10da76, disabling compactions & flushes 2023-09-29 17:01:56,073 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. after waiting 0 ms 2023-09-29 17:01:56,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,073 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,074 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 60f274477d727c3d1f1dbf06ab10da76: 2023-09-29 17:01:56,076 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:01:56,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006916077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006916077"}]},"ts":"1696006916077"} 2023-09-29 17:01:56,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006916077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006916077"}]},"ts":"1696006916077"} 2023-09-29 17:01:56,082 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 17:01:56,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:01:56,083 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006916083"}]},"ts":"1696006916083"} 2023-09-29 17:01:56,084 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-29 17:01:56,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:01:56,095 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:01:56,095 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:01:56,095 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:01:56,095 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:01:56,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60f274477d727c3d1f1dbf06ab10da76, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5bf82b3bbbe2e971c4c7e5257532d22c, ASSIGN}] 2023-09-29 17:01:56,098 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60f274477d727c3d1f1dbf06ab10da76, ASSIGN 2023-09-29 17:01:56,098 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5bf82b3bbbe2e971c4c7e5257532d22c, ASSIGN 2023-09-29 17:01:56,099 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60f274477d727c3d1f1dbf06ab10da76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44759,1696006873606; forceNewPlan=false, retain=false 2023-09-29 17:01:56,099 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5bf82b3bbbe2e971c4c7e5257532d22c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45619,1696006873557; forceNewPlan=false, retain=false 2023-09-29 17:01:56,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 17:01:56,249 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 17:01:56,252 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=60f274477d727c3d1f1dbf06ab10da76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5bf82b3bbbe2e971c4c7e5257532d22c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,252 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006916252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006916252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006916252"}]},"ts":"1696006916252"} 2023-09-29 17:01:56,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006916252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006916252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006916252"}]},"ts":"1696006916252"} 2023-09-29 17:01:56,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 60f274477d727c3d1f1dbf06ab10da76, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:01:56,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 5bf82b3bbbe2e971c4c7e5257532d22c, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:01:56,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60f274477d727c3d1f1dbf06ab10da76, NAME => 'testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 17:01:56,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. service=AccessControlService 2023-09-29 17:01:56,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:56,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5bf82b3bbbe2e971c4c7e5257532d22c, NAME => 'testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. service=AccessControlService 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:56,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:56,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:56,415 INFO [StoreOpener-60f274477d727c3d1f1dbf06ab10da76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:56,415 INFO [StoreOpener-5bf82b3bbbe2e971c4c7e5257532d22c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:56,417 DEBUG [StoreOpener-60f274477d727c3d1f1dbf06ab10da76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf 2023-09-29 17:01:56,417 DEBUG [StoreOpener-60f274477d727c3d1f1dbf06ab10da76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf 2023-09-29 17:01:56,417 DEBUG [StoreOpener-5bf82b3bbbe2e971c4c7e5257532d22c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf 2023-09-29 17:01:56,417 DEBUG [StoreOpener-5bf82b3bbbe2e971c4c7e5257532d22c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf 2023-09-29 17:01:56,417 INFO [StoreOpener-60f274477d727c3d1f1dbf06ab10da76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60f274477d727c3d1f1dbf06ab10da76 columnFamilyName cf 2023-09-29 17:01:56,417 INFO [StoreOpener-5bf82b3bbbe2e971c4c7e5257532d22c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5bf82b3bbbe2e971c4c7e5257532d22c columnFamilyName cf 2023-09-29 17:01:56,418 INFO [StoreOpener-60f274477d727c3d1f1dbf06ab10da76-1] regionserver.HStore(310): Store=60f274477d727c3d1f1dbf06ab10da76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:56,419 INFO [StoreOpener-5bf82b3bbbe2e971c4c7e5257532d22c-1] regionserver.HStore(310): Store=5bf82b3bbbe2e971c4c7e5257532d22c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:01:56,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:56,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:56,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:56,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:56,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:01:56,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:01:56,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:56,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:01:56,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 60f274477d727c3d1f1dbf06ab10da76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72797978, jitterRate=0.08477440476417542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:56,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 60f274477d727c3d1f1dbf06ab10da76: 2023-09-29 17:01:56,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5bf82b3bbbe2e971c4c7e5257532d22c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65277993, jitterRate=-0.027282103896141052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:01:56,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5bf82b3bbbe2e971c4c7e5257532d22c: 2023-09-29 17:01:56,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76., pid=45, masterSystemTime=1696006916406 2023-09-29 17:01:56,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c., pid=46, masterSystemTime=1696006916407 2023-09-29 17:01:56,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,431 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=60f274477d727c3d1f1dbf06ab10da76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:56,431 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006916431"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006916431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006916431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006916431"}]},"ts":"1696006916431"} 2023-09-29 17:01:56,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:56,432 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5bf82b3bbbe2e971c4c7e5257532d22c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,432 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006916432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006916432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006916432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006916432"}]},"ts":"1696006916432"} 2023-09-29 17:01:56,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-29 17:01:56,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 60f274477d727c3d1f1dbf06ab10da76, server=jenkins-hbase4.apache.org,44759,1696006873606 in 179 msec 2023-09-29 17:01:56,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-29 17:01:56,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 5bf82b3bbbe2e971c4c7e5257532d22c, server=jenkins-hbase4.apache.org,45619,1696006873557 in 179 msec 2023-09-29 17:01:56,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60f274477d727c3d1f1dbf06ab10da76, ASSIGN in 340 msec 2023-09-29 17:01:56,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-29 17:01:56,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5bf82b3bbbe2e971c4c7e5257532d22c, ASSIGN in 342 msec 2023-09-29 17:01:56,440 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:01:56,441 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006916440"}]},"ts":"1696006916440"} 2023-09-29 17:01:56,442 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-29 17:01:56,446 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:01:56,446 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-29 17:01:56,448 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-29 17:01:56,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:56,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:56,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:56,450 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:01:56,452 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:56,452 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:56,452 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:56,452 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 17:01:56,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 825 msec 2023-09-29 17:01:56,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 17:01:56,739 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-29 17:01:56,741 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-29 17:01:56,741 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,744 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:01:56,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 17:01:56,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006916756 (current time:1696006916756). 2023-09-29 17:01:56,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:01:56,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x674bd45b to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:56,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cecf0fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:56,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:56,768 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:56,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x674bd45b to 127.0.0.1:64917 2023-09-29 17:01:56,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:56,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x5078db06 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:56,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69a8245e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:56,778 DEBUG [hconnection-0x72584a8e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:56,781 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:56,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5078db06 to 127.0.0.1:64917 2023-09-29 17:01:56,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:56,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-29 17:01:56,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:01:56,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 17:01:56,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 17:01:56,791 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 17:01:56,792 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696007516792 2023-09-29 17:01:56,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-29 17:01:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 17:01:56,794 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:01:56,794 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:01:56,798 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 17:01:56,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 17:01:56,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-29 17:01:56,801 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 17:01:56,802 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696007516802 2023-09-29 17:01:56,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,814 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-29 17:01:56,815 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:56,816 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-29 17:01:56,816 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-29 17:01:56,817 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,817 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,819 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:56,819 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:56,819 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:56,819 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:56,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:56,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:56,819 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,819 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,820 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,820 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 17:01:56,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,821 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 17:01:56,821 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:56,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-29 17:01:56,826 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 17:01:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-29 17:01:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,826 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-29 17:01:56,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 17:01:56,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 17:01:56,826 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-29 17:01:56,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,826 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 17:01:56,826 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 17:01:56,827 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:56,826 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:56,828 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 17:01:56,831 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 17:01:56,831 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-29 17:01:56,831 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-29 17:01:56,831 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-29 17:01:56,831 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-29 17:01:56,832 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,833 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,833 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:56,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:56,834 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,834 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:56,834 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,834 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:56,834 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,834 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:56,834 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,834 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:56,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:56,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-29 17:01:56,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 1] remaining members to acquire global barrier 2023-09-29 17:01:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:56,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-29 17:01:56,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 0] remaining members to acquire global barrier 2023-09-29 17:01:56,838 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-29 17:01:56,838 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,840 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,840 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,840 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,841 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 17:01:56,841 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 17:01:56,841 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-29 17:01:56,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,841 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,841 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:56,841 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:56,841 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:01:56,841 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:56,841 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 17:01:56,841 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,841 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. started... 2023-09-29 17:01:56,841 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:01:56,842 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:56,842 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:56,843 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5bf82b3bbbe2e971c4c7e5257532d22c: 2023-09-29 17:01:56,843 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,843 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. started... 2023-09-29 17:01:56,843 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,843 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:56,843 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:01:56,843 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60f274477d727c3d1f1dbf06ab10da76: 2023-09-29 17:01:56,844 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,845 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:56,845 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:01:56,850 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 17:01:56,851 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:56,851 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-29 17:01:56,859 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. completed. 2023-09-29 17:01:56,860 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:56,860 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. completed. 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:56,860 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-29 17:01:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:01:56,862 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 17:01:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:56,862 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 17:01:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-29 17:01:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:56,864 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-29 17:01:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:01:56,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-29 17:01:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:01:56,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-29 17:01:56,873 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-29 17:01:56,873 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:01:56,873 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:01:56,873 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,873 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:01:56,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:56,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:56,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,876 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:56,876 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:56,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:56,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:56,877 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,877 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:56,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:56,879 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,880 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,880 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:56,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:56,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:56,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,883 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:56,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:56,883 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:56,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:56,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:56,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:56,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-29 17:01:56,885 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:56,885 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:56,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:56,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:56,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:01:56,886 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,886 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:56,886 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:56,886 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,886 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:56,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:56,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 17:01:56,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,894 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:56,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 17:01:56,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:56,896 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:01:56,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-29 17:01:56,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,913 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-29 17:01:56,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696006916793Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696006916894 (+101 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696006916894Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696006916894Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696006916898 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696006916906 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696006916913 (+7 ms) 2023-09-29 17:01:56,916 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 17:01:56,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 122 msec 2023-09-29 17:01:57,096 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:57,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 17:01:57,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:01:57,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44759] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:01:57,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45619] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:01:57,105 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-29 17:01:57,105 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:57,105 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:01:57,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 17:01:57,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006917115 (current time:1696006917115). 2023-09-29 17:01:57,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:01:57,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x123d0480 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:57,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@335f471c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:57,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:57,134 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:57,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x123d0480 to 127.0.0.1:64917 2023-09-29 17:01:57,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:57,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x6220d89c to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:01:57,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18c3c95c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:01:57,145 DEBUG [hconnection-0x516d1aff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:01:57,146 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:01:57,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6220d89c to 127.0.0.1:64917 2023-09-29 17:01:57,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:01:57,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-29 17:01:57,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:01:57,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 17:01:57,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 17:01:57,158 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 17:01:57,159 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696007517159 2023-09-29 17:01:57,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 17:01:57,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-29 17:01:57,161 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:01:57,161 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:01:57,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 17:01:57,162 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 17:01:57,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-29 17:01:57,165 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 17:01:57,165 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696007517165 2023-09-29 17:01:57,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-29 17:01:57,178 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-29 17:01:57,178 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:57,180 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-29 17:01:57,180 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-29 17:01:57,180 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,180 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,182 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,183 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:57,183 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:57,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:57,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:57,183 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:57,183 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:57,183 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:57,183 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,183 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:01:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 17:01:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-29 17:01:57,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 17:01:57,185 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 17:01:57,185 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:57,190 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 17:01:57,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-29 17:01:57,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-29 17:01:57,190 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 17:01:57,190 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 17:01:57,190 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:57,190 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-29 17:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 17:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-29 17:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-29 17:01:57,190 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-29 17:01:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 17:01:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-29 17:01:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-29 17:01:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,194 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,195 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:57,195 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,195 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,195 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,195 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:57,195 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:01:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:57,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-29 17:01:57,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 1] remaining members to acquire global barrier 2023-09-29 17:01:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:57,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-29 17:01:57,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 0] remaining members to acquire global barrier 2023-09-29 17:01:57,199 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-29 17:01:57,199 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,200 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 17:01:57,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:57,201 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:57,201 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,201 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. started... 2023-09-29 17:01:57,201 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:01:57,201 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:01:57,201 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 60f274477d727c3d1f1dbf06ab10da76 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-29 17:01:57,201 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. started... 2023-09-29 17:01:57,202 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,202 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:01:57,202 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5bf82b3bbbe2e971c4c7e5257532d22c 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-29 17:01:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 17:01:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-29 17:01:57,231 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230929db730ced0d15436f8c832100f6d0ef9b to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929db730ced0d15436f8c832100f6d0ef9b 2023-09-29 17:01:57,231 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309294faa7b2e599f40abbc0c15ba6e2dfc32 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309294faa7b2e599f40abbc0c15ba6e2dfc32 2023-09-29 17:01:57,250 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/.tmp/cf/1f5b4191875143728174353348afb1cc 2023-09-29 17:01:57,253 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/.tmp/cf/7a48833ac99c4c3888fbcf7c82f1c494 2023-09-29 17:01:57,256 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/.tmp/cf/1f5b4191875143728174353348afb1cc as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf/1f5b4191875143728174353348afb1cc 2023-09-29 17:01:57,258 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/.tmp/cf/7a48833ac99c4c3888fbcf7c82f1c494 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf/7a48833ac99c4c3888fbcf7c82f1c494 2023-09-29 17:01:57,261 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:57,261 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf/1f5b4191875143728174353348afb1cc, entries=4, sequenceid=6, filesize=5.6 K 2023-09-29 17:01:57,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 17:01:57,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:01:57,262 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:01:57,262 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 60f274477d727c3d1f1dbf06ab10da76 in 61ms, sequenceid=6, compaction requested=false 2023-09-29 17:01:57,263 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-29 17:01:57,263 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60f274477d727c3d1f1dbf06ab10da76: 2023-09-29 17:01:57,263 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-29 17:01:57,263 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:57,263 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf/1f5b4191875143728174353348afb1cc] hfiles 2023-09-29 17:01:57,263 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf/1f5b4191875143728174353348afb1cc for snapshot=snaptb0-testConsecutiveExports 2023-09-29 17:01:57,264 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf/7a48833ac99c4c3888fbcf7c82f1c494, entries=46, sequenceid=6, filesize=12.5 K 2023-09-29 17:01:57,265 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 5bf82b3bbbe2e971c4c7e5257532d22c in 63ms, sequenceid=6, compaction requested=false 2023-09-29 17:01:57,266 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5bf82b3bbbe2e971c4c7e5257532d22c: 2023-09-29 17:01:57,267 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-29 17:01:57,267 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:01:57,267 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf/7a48833ac99c4c3888fbcf7c82f1c494] hfiles 2023-09-29 17:01:57,267 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf/7a48833ac99c4c3888fbcf7c82f1c494 for snapshot=snaptb0-testConsecutiveExports 2023-09-29 17:01:57,273 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. completed. 2023-09-29 17:01:57,273 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:01:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,277 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-29 17:01:57,277 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:01:57,279 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,279 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 17:01:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:57,279 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:57,279 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-29 17:01:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:57,281 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. completed. 2023-09-29 17:01:57,281 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:01:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:57,281 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:01:57,282 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:01:57,282 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,282 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-29 17:01:57,282 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:01:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,283 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,283 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 17:01:57,283 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:57,283 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-29 17:01:57,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:01:57,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-29 17:01:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:01:57,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-29 17:01:57,290 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-29 17:01:57,290 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:01:57,290 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:01:57,290 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-29 17:01:57,290 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:01:57,292 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:57,292 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:01:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:01:57,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:57,292 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:01:57,292 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:57,293 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:57,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:57,293 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:01:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:01:57,296 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 17:01:57,296 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,296 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:57,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:57,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:57,304 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:01:57,306 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:01:57,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:01:57,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:57,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-29 17:01:57,304 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-29 17:01:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:01:57,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:57,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-29 17:01:57,307 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:01:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:57,307 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,307 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:01:57,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:01:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:01:57,307 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,308 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:01:57,308 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:01:57,308 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,308 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929db730ced0d15436f8c832100f6d0ef9b, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309294faa7b2e599f40abbc0c15ba6e2dfc32] mob files 2023-09-29 17:01:57,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929db730ced0d15436f8c832100f6d0ef9b 2023-09-29 17:01:57,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309294faa7b2e599f40abbc0c15ba6e2dfc32 2023-09-29 17:01:57,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-29 17:01:57,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-29 17:01:57,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,340 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696006917159Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696006917319 (+160 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696006917319Loading Region manifests for snaptb0-testConsecutiveExports at 1696006917319Writing data manifest for snaptb0-testConsecutiveExports at 1696006917324 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696006917332 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696006917340 (+8 ms) 2023-09-29 17:01:57,343 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 17:01:57,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 183 msec 2023-09-29 17:01:57,463 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:01:57,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 17:01:57,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:01:57,464 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464 2023-09-29 17:01:57,464 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464, srcFsUri=hdfs://localhost:39529, srcDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:57,486 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:01:57,486 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1107e029, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,486 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, snapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-29 17:01:57,496 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 17:01:57,509 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:57,510 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:57,510 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:57,511 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,400 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-8618266732960240615.jar 2023-09-29 17:01:58,401 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,401 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,468 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-1482197911943458835.jar 2023-09-29 17:01:58,469 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,469 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,470 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,470 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,470 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,471 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 17:01:58,471 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 17:01:58,471 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 17:01:58,472 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 17:01:58,472 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 17:01:58,473 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 17:01:58,473 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 17:01:58,473 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 17:01:58,474 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 17:01:58,474 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 17:01:58,475 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 17:01:58,475 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:58,475 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:58,476 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:58,476 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:58,476 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:01:58,477 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:58,478 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:01:58,863 WARN [Listener at jenkins-hbase4.apache.org/46659] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 17:01:58,865 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-29 17:01:58,867 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-29 17:01:59,827 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:01:59,827 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:01:59,830 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0002_000001 (auth:SIMPLE) 2023-09-29 17:02:00,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0003_000001 (auth:SIMPLE) 2023-09-29 17:02:00,889 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:02:04,551 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0003_000001 (auth:SIMPLE) 2023-09-29 17:02:06,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0003_000001 (auth:SIMPLE) 2023-09-29 17:02:09,133 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0003_000001 (auth:SIMPLE) 2023-09-29 17:02:11,039 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 17:02:11,040 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 17:02:11,044 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-29 17:02:11,044 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 17:02:11,045 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 17:02:11,045 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 17:02:11,048 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 17:02:11,048 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 17:02:11,048 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3210aa1a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 17:02:11,048 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 17:02:11,048 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 17:02:11,050 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464, srcFsUri=hdfs://localhost:39529, srcDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:11,071 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:11,072 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@267fed8c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 17:02:11,072 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, snapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-29 17:02:11,084 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 17:02:11,097 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:11,097 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:11,098 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:11,098 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:11,975 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-4674695375213576729.jar 2023-09-29 17:02:11,975 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:11,976 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:12,044 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-5003484086400396115.jar 2023-09-29 17:02:12,045 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:12,045 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:12,045 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:12,046 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:12,046 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:12,046 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:12,047 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 17:02:12,047 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 17:02:12,047 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 17:02:12,048 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 17:02:12,048 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 17:02:12,049 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 17:02:12,049 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 17:02:12,049 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 17:02:12,050 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 17:02:12,050 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 17:02:12,051 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:12,051 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:12,052 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:12,052 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:12,052 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:12,053 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:12,053 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:12,430 WARN [Listener at jenkins-hbase4.apache.org/46659] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 17:02:12,433 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-29 17:02:12,435 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-29 17:02:15,301 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:15,302 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:15,304 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0003_000001 (auth:SIMPLE) 2023-09-29 17:02:15,840 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0004_000001 (auth:SIMPLE) 2023-09-29 17:02:19,623 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0004_000001 (auth:SIMPLE) 2023-09-29 17:02:21,838 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0004_000001 (auth:SIMPLE) 2023-09-29 17:02:24,186 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0004_000001 (auth:SIMPLE) 2023-09-29 17:02:25,597 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 17:02:25,598 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 17:02:25,600 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-29 17:02:25,601 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 17:02:25,601 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 17:02:25,601 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 17:02:25,605 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 17:02:25,606 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 17:02:25,606 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3210aa1a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 17:02:25,606 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 17:02:25,606 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/local-export-1696006917464/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 17:02:25,620 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-29 17:02:25,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-29 17:02:25,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:02:25,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-29 17:02:25,625 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006945625"}]},"ts":"1696006945625"} 2023-09-29 17:02:25,626 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-29 17:02:25,628 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-29 17:02:25,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60f274477d727c3d1f1dbf06ab10da76, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5bf82b3bbbe2e971c4c7e5257532d22c, UNASSIGN}] 2023-09-29 17:02:25,631 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60f274477d727c3d1f1dbf06ab10da76, UNASSIGN 2023-09-29 17:02:25,631 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5bf82b3bbbe2e971c4c7e5257532d22c, UNASSIGN 2023-09-29 17:02:25,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=60f274477d727c3d1f1dbf06ab10da76, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:25,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006945632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006945632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006945632"}]},"ts":"1696006945632"} 2023-09-29 17:02:25,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5bf82b3bbbe2e971c4c7e5257532d22c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:25,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006945632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006945632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006945632"}]},"ts":"1696006945632"} 2023-09-29 17:02:25,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 60f274477d727c3d1f1dbf06ab10da76, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:25,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 5bf82b3bbbe2e971c4c7e5257532d22c, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:25,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-29 17:02:25,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:02:25,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 60f274477d727c3d1f1dbf06ab10da76, disabling compactions & flushes 2023-09-29 17:02:25,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:02:25,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:02:25,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. after waiting 0 ms 2023-09-29 17:02:25,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:02:25,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:02:25,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5bf82b3bbbe2e971c4c7e5257532d22c, disabling compactions & flushes 2023-09-29 17:02:25,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:02:25,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:02:25,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. after waiting 0 ms 2023-09-29 17:02:25,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:02:25,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:02:25,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:02:25,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:25,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:25,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76. 2023-09-29 17:02:25,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c. 2023-09-29 17:02:25,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 60f274477d727c3d1f1dbf06ab10da76: 2023-09-29 17:02:25,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5bf82b3bbbe2e971c4c7e5257532d22c: 2023-09-29 17:02:25,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:02:25,805 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5bf82b3bbbe2e971c4c7e5257532d22c, regionState=CLOSED 2023-09-29 17:02:25,805 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006945805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006945805"}]},"ts":"1696006945805"} 2023-09-29 17:02:25,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:02:25,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=60f274477d727c3d1f1dbf06ab10da76, regionState=CLOSED 2023-09-29 17:02:25,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696006945806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006945806"}]},"ts":"1696006945806"} 2023-09-29 17:02:25,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-29 17:02:25,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 5bf82b3bbbe2e971c4c7e5257532d22c, server=jenkins-hbase4.apache.org,45619,1696006873557 in 172 msec 2023-09-29 17:02:25,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-29 17:02:25,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 60f274477d727c3d1f1dbf06ab10da76, server=jenkins-hbase4.apache.org,44759,1696006873606 in 174 msec 2023-09-29 17:02:25,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5bf82b3bbbe2e971c4c7e5257532d22c, UNASSIGN in 180 msec 2023-09-29 17:02:25,811 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-29 17:02:25,811 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60f274477d727c3d1f1dbf06ab10da76, UNASSIGN in 181 msec 2023-09-29 17:02:25,812 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006945812"}]},"ts":"1696006945812"} 2023-09-29 17:02:25,813 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-29 17:02:25,815 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-29 17:02:25,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 195 msec 2023-09-29 17:02:25,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-29 17:02:25,928 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-29 17:02:25,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-29 17:02:25,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:02:25,932 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:02:25,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-29 17:02:25,933 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:02:25,935 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-29 17:02:25,939 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:02:25,939 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:02:25,939 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,939 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,939 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,939 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 17:02:25,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 17:02:25,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 17:02:25,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 17:02:25,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:25,942 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/recovered.edits] 2023-09-29 17:02:25,942 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/recovered.edits] 2023-09-29 17:02:25,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-29 17:02:25,948 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf/1f5b4191875143728174353348afb1cc to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/cf/1f5b4191875143728174353348afb1cc 2023-09-29 17:02:25,948 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf/7a48833ac99c4c3888fbcf7c82f1c494 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/cf/7a48833ac99c4c3888fbcf7c82f1c494 2023-09-29 17:02:25,951 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76/recovered.edits/9.seqid 2023-09-29 17:02:25,951 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c/recovered.edits/9.seqid 2023-09-29 17:02:25,952 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/60f274477d727c3d1f1dbf06ab10da76 2023-09-29 17:02:25,952 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testConsecutiveExports/5bf82b3bbbe2e971c4c7e5257532d22c 2023-09-29 17:02:25,952 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-29 17:02:25,953 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-29 17:02:25,954 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-29 17:02:25,959 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929db730ced0d15436f8c832100f6d0ef9b to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929db730ced0d15436f8c832100f6d0ef9b 2023-09-29 17:02:25,960 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309294faa7b2e599f40abbc0c15ba6e2dfc32 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309294faa7b2e599f40abbc0c15ba6e2dfc32 2023-09-29 17:02:25,961 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-29 17:02:25,963 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:02:25,966 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-29 17:02:25,968 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-29 17:02:25,969 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:02:25,969 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-29 17:02:25,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006945969"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:25,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006945969"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:25,971 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 17:02:25,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 60f274477d727c3d1f1dbf06ab10da76, NAME => 'testtb-testConsecutiveExports,,1696006915626.60f274477d727c3d1f1dbf06ab10da76.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5bf82b3bbbe2e971c4c7e5257532d22c, NAME => 'testtb-testConsecutiveExports,1,1696006915626.5bf82b3bbbe2e971c4c7e5257532d22c.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 17:02:25,971 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-29 17:02:25,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696006945971"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:25,973 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-29 17:02:25,975 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 17:02:25,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 47 msec 2023-09-29 17:02:26,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-29 17:02:26,045 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-29 17:02:26,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-29 17:02:26,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-29 17:02:26,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-29 17:02:26,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-29 17:02:26,082 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 765), OpenFileDescriptor=898 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=322 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=899 (was 1000) 2023-09-29 17:02:26,083 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-29 17:02:26,103 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=168, AvailableMemoryMB=898 2023-09-29 17:02:26,103 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-29 17:02:26,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 17:02:26,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,108 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:02:26,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-29 17:02:26,109 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:02:26,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 17:02:26,112 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,112 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,112 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494 empty. 2023-09-29 17:02:26,112 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df empty. 2023-09-29 17:02:26,113 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,113 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,113 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-29 17:02:26,122 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-29 17:02:26,124 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c10a3499ed25c6f5e993677e956fc9df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:26,124 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 339eb74e50ed1fd56b5c9701a8e5b494, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 339eb74e50ed1fd56b5c9701a8e5b494, disabling compactions & flushes 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c10a3499ed25c6f5e993677e956fc9df, disabling compactions & flushes 2023-09-29 17:02:26,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. after waiting 0 ms 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. after waiting 0 ms 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,133 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,133 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c10a3499ed25c6f5e993677e956fc9df: 2023-09-29 17:02:26,133 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 339eb74e50ed1fd56b5c9701a8e5b494: 2023-09-29 17:02:26,135 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:02:26,136 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006946136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006946136"}]},"ts":"1696006946136"} 2023-09-29 17:02:26,136 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006946136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006946136"}]},"ts":"1696006946136"} 2023-09-29 17:02:26,142 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 17:02:26,143 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:02:26,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006946143"}]},"ts":"1696006946143"} 2023-09-29 17:02:26,144 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-29 17:02:26,148 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:02:26,150 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:02:26,150 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:02:26,150 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:02:26,150 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:02:26,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=339eb74e50ed1fd56b5c9701a8e5b494, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c10a3499ed25c6f5e993677e956fc9df, ASSIGN}] 2023-09-29 17:02:26,153 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c10a3499ed25c6f5e993677e956fc9df, ASSIGN 2023-09-29 17:02:26,153 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=339eb74e50ed1fd56b5c9701a8e5b494, ASSIGN 2023-09-29 17:02:26,153 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c10a3499ed25c6f5e993677e956fc9df, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44759,1696006873606; forceNewPlan=false, retain=false 2023-09-29 17:02:26,153 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=339eb74e50ed1fd56b5c9701a8e5b494, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44811,1696006873656; forceNewPlan=false, retain=false 2023-09-29 17:02:26,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 17:02:26,304 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 17:02:26,306 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=339eb74e50ed1fd56b5c9701a8e5b494, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,306 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c10a3499ed25c6f5e993677e956fc9df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,307 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006946306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006946306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006946306"}]},"ts":"1696006946306"} 2023-09-29 17:02:26,307 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006946306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006946306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006946306"}]},"ts":"1696006946306"} 2023-09-29 17:02:26,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 339eb74e50ed1fd56b5c9701a8e5b494, server=jenkins-hbase4.apache.org,44811,1696006873656}] 2023-09-29 17:02:26,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure c10a3499ed25c6f5e993677e956fc9df, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:26,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 17:02:26,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 339eb74e50ed1fd56b5c9701a8e5b494, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c10a3499ed25c6f5e993677e956fc9df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. service=AccessControlService 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. service=AccessControlService 2023-09-29 17:02:26,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:26,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:26,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:26,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,474 INFO [StoreOpener-c10a3499ed25c6f5e993677e956fc9df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,474 INFO [StoreOpener-339eb74e50ed1fd56b5c9701a8e5b494-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,476 DEBUG [StoreOpener-c10a3499ed25c6f5e993677e956fc9df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf 2023-09-29 17:02:26,476 DEBUG [StoreOpener-339eb74e50ed1fd56b5c9701a8e5b494-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf 2023-09-29 17:02:26,476 DEBUG [StoreOpener-c10a3499ed25c6f5e993677e956fc9df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf 2023-09-29 17:02:26,477 DEBUG [StoreOpener-339eb74e50ed1fd56b5c9701a8e5b494-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf 2023-09-29 17:02:26,478 INFO [StoreOpener-c10a3499ed25c6f5e993677e956fc9df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c10a3499ed25c6f5e993677e956fc9df columnFamilyName cf 2023-09-29 17:02:26,478 INFO [StoreOpener-339eb74e50ed1fd56b5c9701a8e5b494-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 339eb74e50ed1fd56b5c9701a8e5b494 columnFamilyName cf 2023-09-29 17:02:26,479 INFO [StoreOpener-339eb74e50ed1fd56b5c9701a8e5b494-1] regionserver.HStore(310): Store=339eb74e50ed1fd56b5c9701a8e5b494/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:26,479 INFO [StoreOpener-c10a3499ed25c6f5e993677e956fc9df-1] regionserver.HStore(310): Store=c10a3499ed25c6f5e993677e956fc9df/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:26,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:26,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:26,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:26,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:26,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 339eb74e50ed1fd56b5c9701a8e5b494; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69777935, jitterRate=0.03977225720882416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:26,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 339eb74e50ed1fd56b5c9701a8e5b494: 2023-09-29 17:02:26,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c10a3499ed25c6f5e993677e956fc9df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68915568, jitterRate=0.026921987533569336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:26,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c10a3499ed25c6f5e993677e956fc9df: 2023-09-29 17:02:26,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494., pid=60, masterSystemTime=1696006946460 2023-09-29 17:02:26,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df., pid=61, masterSystemTime=1696006946461 2023-09-29 17:02:26,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,492 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=339eb74e50ed1fd56b5c9701a8e5b494, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,492 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006946491"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006946491"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006946491"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006946491"}]},"ts":"1696006946491"} 2023-09-29 17:02:26,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,492 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c10a3499ed25c6f5e993677e956fc9df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,493 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006946492"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006946492"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006946492"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006946492"}]},"ts":"1696006946492"} 2023-09-29 17:02:26,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-29 17:02:26,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 339eb74e50ed1fd56b5c9701a8e5b494, server=jenkins-hbase4.apache.org,44811,1696006873656 in 186 msec 2023-09-29 17:02:26,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-29 17:02:26,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure c10a3499ed25c6f5e993677e956fc9df, server=jenkins-hbase4.apache.org,44759,1696006873606 in 185 msec 2023-09-29 17:02:26,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=339eb74e50ed1fd56b5c9701a8e5b494, ASSIGN in 346 msec 2023-09-29 17:02:26,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-29 17:02:26,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c10a3499ed25c6f5e993677e956fc9df, ASSIGN in 346 msec 2023-09-29 17:02:26,499 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:02:26,499 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006946499"}]},"ts":"1696006946499"} 2023-09-29 17:02:26,501 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-29 17:02:26,503 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:02:26,503 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-29 17:02:26,506 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-29 17:02:26,507 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:26,507 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:26,507 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:26,507 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:26,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:26,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:26,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:26,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:26,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 404 msec 2023-09-29 17:02:26,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 17:02:26,714 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-29 17:02:26,716 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,716 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,718 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:02:26,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 17:02:26,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006946731 (current time:1696006946731). 2023-09-29 17:02:26,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:02:26,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x7dc34aa1 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:26,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@519132b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:26,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:26,743 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:26,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dc34aa1 to 127.0.0.1:64917 2023-09-29 17:02:26,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:26,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x42a81efb to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:26,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2559d24d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:26,752 DEBUG [hconnection-0x7d0540d2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:26,755 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:26,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a81efb to 127.0.0.1:64917 2023-09-29 17:02:26,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:26,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-29 17:02:26,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:02:26,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 17:02:26,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 17:02:26,765 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 17:02:26,766 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696007546766 2023-09-29 17:02:26,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 17:02:26,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,768 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:02:26,768 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:02:26,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 17:02:26,769 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 17:02:26,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-29 17:02:26,771 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 17:02:26,772 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696007546771 2023-09-29 17:02:26,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,781 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-29 17:02:26,782 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:26,783 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-29 17:02:26,783 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-29 17:02:26,784 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,784 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,786 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:26,786 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:26,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:26,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:26,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:26,786 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,786 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:26,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:26,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,787 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,787 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,788 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,788 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,788 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 17:02:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:26,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,790 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 17:02:26,790 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 17:02:26,790 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 17:02:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 17:02:26,790 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 17:02:26,790 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:26,790 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:26,792 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 17:02:26,793 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 17:02:26,793 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 17:02:26,793 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 17:02:26,793 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 17:02:26,793 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 17:02:26,794 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,795 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,795 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,796 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,796 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:26,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 17:02:26,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253a3cbf[Count = 1] remaining members to acquire global barrier 2023-09-29 17:02:26,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:26,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:26,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:26,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 17:02:26,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253a3cbf[Count = 0] remaining members to acquire global barrier 2023-09-29 17:02:26,800 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-29 17:02:26,800 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,801 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,801 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,801 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 17:02:26,801 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 17:02:26,802 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,802 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:26,802 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:26,802 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. started... 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 17:02:26,802 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. started... 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:26,804 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:26,802 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c10a3499ed25c6f5e993677e956fc9df: 2023-09-29 17:02:26,802 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 339eb74e50ed1fd56b5c9701a8e5b494: 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:02:26,804 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:02:26,811 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 17:02:26,811 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:26,811 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 17:02:26,816 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. completed. 2023-09-29 17:02:26,816 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. completed. 2023-09-29 17:02:26,816 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:26,816 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:02:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:02:26,818 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,818 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 17:02:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:26,818 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:26,818 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,818 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 17:02:26,818 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 17:02:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:26,820 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:26,821 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 17:02:26,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:26,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:02:26,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-29 17:02:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:26,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:26,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:26,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44811,1696006873656': 2023-09-29 17:02:26,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-29 17:02:26,829 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-29 17:02:26,829 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:02:26,829 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:02:26,829 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,829 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:02:26,830 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,830 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:26,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:26,830 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,830 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,830 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:26,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,831 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:26,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,831 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:26,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:26,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:26,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:26,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:26,832 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,832 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:26,833 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:26,835 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,835 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,836 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,839 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:26,839 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:26,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:26,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:26,839 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:26,840 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,841 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,842 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,839 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:26,839 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:26,842 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:26,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-09-29 17:02:26,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,840 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:26,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:26,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,842 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:26,842 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,842 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:26,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:26,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:26,842 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:26,843 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,843 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:26,843 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:26,843 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,843 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 17:02:26,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,868 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:26,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 17:02:26,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:02:26,869 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:02:26,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-29 17:02:26,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,880 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:26,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696006946766Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696006946858 (+92 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696006946858Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696006946858Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696006946863 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696006946873 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696006946880 (+7 ms) 2023-09-29 17:02:26,883 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 17:02:26,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 116 msec 2023-09-29 17:02:27,069 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:27,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 17:02:27,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:02:27,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44811] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:02:27,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44759] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:02:27,077 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,078 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:27,078 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:02:27,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 17:02:27,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006947088 (current time:1696006947088). 2023-09-29 17:02:27,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:02:27,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x296a4b0a to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:27,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@255ff876, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:27,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:27,100 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:27,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x296a4b0a to 127.0.0.1:64917 2023-09-29 17:02:27,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:27,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x4d0d0daa to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:27,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36c42d1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:27,109 DEBUG [hconnection-0x6c82effc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:27,111 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:27,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d0d0daa to 127.0.0.1:64917 2023-09-29 17:02:27,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:27,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-29 17:02:27,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:02:27,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 17:02:27,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 17:02:27,121 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 17:02:27,121 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696007547121 2023-09-29 17:02:27,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 17:02:27,123 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:02:27,123 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:02:27,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 17:02:27,126 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 17:02:27,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-29 17:02:27,128 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 17:02:27,128 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696007547128 2023-09-29 17:02:27,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,137 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-29 17:02:27,137 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:27,138 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-29 17:02:27,139 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-29 17:02:27,139 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,139 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,141 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:27,141 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:27,141 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,141 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:27,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:27,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:27,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:27,142 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,142 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,142 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,142 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-29 17:02:27,143 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 17:02:27,143 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:27,143 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 17:02:27,145 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 17:02:27,145 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,146 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 17:02:27,146 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 17:02:27,145 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 17:02:27,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 17:02:27,146 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 17:02:27,146 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 17:02:27,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,146 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 17:02:27,146 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:27,147 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 17:02:27,147 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 17:02:27,147 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 17:02:27,148 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,148 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,148 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:27,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:27,149 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,149 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:27,149 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:27,149 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,149 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,150 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:27,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:27,150 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,150 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:27,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 1] remaining members to acquire global barrier 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:27,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:27,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:27,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:27,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:27,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 17:02:27,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 0] remaining members to acquire global barrier 2023-09-29 17:02:27,154 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-29 17:02:27,154 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,155 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 17:02:27,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 17:02:27,155 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 17:02:27,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,155 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:02:27,156 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 17:02:27,155 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,156 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:27,156 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:27,156 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:02:27,156 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:27,156 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. started... 2023-09-29 17:02:27,156 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:27,156 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:27,156 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:27,156 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. started... 2023-09-29 17:02:27,156 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 339eb74e50ed1fd56b5c9701a8e5b494 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-29 17:02:27,156 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c10a3499ed25c6f5e993677e956fc9df 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-29 17:02:27,158 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 17:02:27,158 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:27,158 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 17:02:27,175 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230929b761b5a8d00c42b4bf5a3a8764aa22cb to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929b761b5a8d00c42b4bf5a3a8764aa22cb 2023-09-29 17:02:27,177 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230929595580b27fa64a1fac9b17f9e3bf0f58 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230929595580b27fa64a1fac9b17f9e3bf0f58 2023-09-29 17:02:27,184 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/.tmp/cf/d5983bf5f64843d9a22144468097fd7f 2023-09-29 17:02:27,186 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/.tmp/cf/462a08454a074f218bc36f10dbdc036a 2023-09-29 17:02:27,190 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/.tmp/cf/d5983bf5f64843d9a22144468097fd7f as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf/d5983bf5f64843d9a22144468097fd7f 2023-09-29 17:02:27,191 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/.tmp/cf/462a08454a074f218bc36f10dbdc036a as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf/462a08454a074f218bc36f10dbdc036a 2023-09-29 17:02:27,195 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf/d5983bf5f64843d9a22144468097fd7f, entries=5, sequenceid=6, filesize=5.8 K 2023-09-29 17:02:27,196 INFO [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 339eb74e50ed1fd56b5c9701a8e5b494 in 40ms, sequenceid=6, compaction requested=false 2023-09-29 17:02:27,196 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-29 17:02:27,196 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 339eb74e50ed1fd56b5c9701a8e5b494: 2023-09-29 17:02:27,196 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf/462a08454a074f218bc36f10dbdc036a, entries=45, sequenceid=6, filesize=13.2 K 2023-09-29 17:02:27,197 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,197 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:27,197 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf/d5983bf5f64843d9a22144468097fd7f] hfiles 2023-09-29 17:02:27,197 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf/d5983bf5f64843d9a22144468097fd7f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,197 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for c10a3499ed25c6f5e993677e956fc9df in 41ms, sequenceid=6, compaction requested=false 2023-09-29 17:02:27,199 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c10a3499ed25c6f5e993677e956fc9df: 2023-09-29 17:02:27,199 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,199 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:27,199 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf/462a08454a074f218bc36f10dbdc036a] hfiles 2023-09-29 17:02:27,199 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf/462a08454a074f218bc36f10dbdc036a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,207 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. completed. 2023-09-29 17:02:27,207 DEBUG [rs(jenkins-hbase4.apache.org,44811,1696006873656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:27,207 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:27,207 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:27,207 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,207 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 17:02:27,207 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:02:27,208 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. completed. 2023-09-29 17:02:27,208 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:27,208 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:27,208 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:27,208 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,208 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 17:02:27,208 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:02:27,209 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 17:02:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 17:02:27,211 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 17:02:27,211 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:27,211 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:27,211 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 17:02:27,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44811,1696006873656': 2023-09-29 17:02:27,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-29 17:02:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:02:27,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-29 17:02:27,218 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-29 17:02:27,218 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:02:27,218 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:02:27,218 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,218 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:02:27,223 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:27,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 17:02:27,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:02:27,224 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,224 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,224 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:27,224 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:27,224 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,224 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,224 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:02:27,225 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:27,225 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:27,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:27,225 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:27,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:27,225 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:27,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,227 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,227 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,228 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,230 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:27,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:27,231 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,231 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:27,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:27,231 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:27,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:27,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,233 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,233 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,233 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:02:27,233 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:27,234 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,234 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,234 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:27,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230929595580b27fa64a1fac9b17f9e3bf0f58, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929b761b5a8d00c42b4bf5a3a8764aa22cb] mob files 2023-09-29 17:02:27,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230929595580b27fa64a1fac9b17f9e3bf0f58 2023-09-29 17:02:27,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929b761b5a8d00c42b4bf5a3a8764aa22cb 2023-09-29 17:02:27,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-29 17:02:27,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,272 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:27,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696006947122Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696006947247 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696006947247Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696006947247Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696006947251 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696006947263 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696006947272 (+9 ms) 2023-09-29 17:02:27,275 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 17:02:27,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 153 msec 2023-09-29 17:02:27,425 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:27,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 17:02:27,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:02:27,456 DEBUG [Listener at jenkins-hbase4.apache.org/46659] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 17:02:27,461 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 17:02:27,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44759] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-29 17:02:27,463 DEBUG [Listener at jenkins-hbase4.apache.org/46659] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 17:02:27,468 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 17:02:27,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44811] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-29 17:02:27,469 DEBUG [Listener at jenkins-hbase4.apache.org/46659] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 17:02:27,471 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 17:02:27,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45619] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-29 17:02:27,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-29 17:02:27,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:27,477 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:02:27,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-29 17:02:27,478 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:02:27,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 17:02:27,480 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,480 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e empty. 2023-09-29 17:02:27,481 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8 empty. 2023-09-29 17:02:27,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,481 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-29 17:02:27,490 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-29 17:02:27,492 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5d3cd9bae0851b3ba82d9cca3cb4fad8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:27,492 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0e3bb14ffe9acb231bcbcf8cd058d98e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:27,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:27,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 0e3bb14ffe9acb231bcbcf8cd058d98e, disabling compactions & flushes 2023-09-29 17:02:27,500 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:27,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:27,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. after waiting 0 ms 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:27,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 0e3bb14ffe9acb231bcbcf8cd058d98e: 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 5d3cd9bae0851b3ba82d9cca3cb4fad8, disabling compactions & flushes 2023-09-29 17:02:27,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. after waiting 0 ms 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:27,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:27,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 5d3cd9bae0851b3ba82d9cca3cb4fad8: 2023-09-29 17:02:27,503 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:02:27,504 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006947504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006947504"}]},"ts":"1696006947504"} 2023-09-29 17:02:27,504 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006947504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006947504"}]},"ts":"1696006947504"} 2023-09-29 17:02:27,506 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 17:02:27,507 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:02:27,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006947507"}]},"ts":"1696006947507"} 2023-09-29 17:02:27,509 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-29 17:02:27,511 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:02:27,513 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:02:27,513 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:02:27,513 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:02:27,513 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:02:27,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0e3bb14ffe9acb231bcbcf8cd058d98e, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d3cd9bae0851b3ba82d9cca3cb4fad8, ASSIGN}] 2023-09-29 17:02:27,516 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d3cd9bae0851b3ba82d9cca3cb4fad8, ASSIGN 2023-09-29 17:02:27,516 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0e3bb14ffe9acb231bcbcf8cd058d98e, ASSIGN 2023-09-29 17:02:27,517 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d3cd9bae0851b3ba82d9cca3cb4fad8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44759,1696006873606; forceNewPlan=false, retain=false 2023-09-29 17:02:27,517 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0e3bb14ffe9acb231bcbcf8cd058d98e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45619,1696006873557; forceNewPlan=false, retain=false 2023-09-29 17:02:27,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 17:02:27,667 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 17:02:27,670 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0e3bb14ffe9acb231bcbcf8cd058d98e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,670 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5d3cd9bae0851b3ba82d9cca3cb4fad8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,670 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006947670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006947670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006947670"}]},"ts":"1696006947670"} 2023-09-29 17:02:27,670 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006947670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006947670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006947670"}]},"ts":"1696006947670"} 2023-09-29 17:02:27,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 0e3bb14ffe9acb231bcbcf8cd058d98e, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:27,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 5d3cd9bae0851b3ba82d9cca3cb4fad8, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:27,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 17:02:27,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:27,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e3bb14ffe9acb231bcbcf8cd058d98e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.', STARTKEY => '', ENDKEY => '2'} 2023-09-29 17:02:27,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:27,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d3cd9bae0851b3ba82d9cca3cb4fad8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.', STARTKEY => '2', ENDKEY => ''} 2023-09-29 17:02:27,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. service=AccessControlService 2023-09-29 17:02:27,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. service=AccessControlService 2023-09-29 17:02:27,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:27,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,829 INFO [StoreOpener-0e3bb14ffe9acb231bcbcf8cd058d98e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,829 INFO [StoreOpener-5d3cd9bae0851b3ba82d9cca3cb4fad8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,830 DEBUG [StoreOpener-0e3bb14ffe9acb231bcbcf8cd058d98e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf 2023-09-29 17:02:27,830 DEBUG [StoreOpener-5d3cd9bae0851b3ba82d9cca3cb4fad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf 2023-09-29 17:02:27,830 DEBUG [StoreOpener-5d3cd9bae0851b3ba82d9cca3cb4fad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf 2023-09-29 17:02:27,830 DEBUG [StoreOpener-0e3bb14ffe9acb231bcbcf8cd058d98e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf 2023-09-29 17:02:27,831 INFO [StoreOpener-5d3cd9bae0851b3ba82d9cca3cb4fad8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d3cd9bae0851b3ba82d9cca3cb4fad8 columnFamilyName cf 2023-09-29 17:02:27,831 INFO [StoreOpener-0e3bb14ffe9acb231bcbcf8cd058d98e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e3bb14ffe9acb231bcbcf8cd058d98e columnFamilyName cf 2023-09-29 17:02:27,831 INFO [StoreOpener-5d3cd9bae0851b3ba82d9cca3cb4fad8-1] regionserver.HStore(310): Store=5d3cd9bae0851b3ba82d9cca3cb4fad8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:27,832 INFO [StoreOpener-0e3bb14ffe9acb231bcbcf8cd058d98e-1] regionserver.HStore(310): Store=0e3bb14ffe9acb231bcbcf8cd058d98e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:27,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:27,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:27,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:27,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:27,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0e3bb14ffe9acb231bcbcf8cd058d98e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71874210, jitterRate=0.07100918889045715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:27,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d3cd9bae0851b3ba82d9cca3cb4fad8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58950444, jitterRate=-0.1215699315071106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:27,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0e3bb14ffe9acb231bcbcf8cd058d98e: 2023-09-29 17:02:27,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d3cd9bae0851b3ba82d9cca3cb4fad8: 2023-09-29 17:02:27,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8., pid=70, masterSystemTime=1696006947825 2023-09-29 17:02:27,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e., pid=69, masterSystemTime=1696006947823 2023-09-29 17:02:27,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:27,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:27,841 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5d3cd9bae0851b3ba82d9cca3cb4fad8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:27,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:27,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:27,841 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006947841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006947841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006947841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006947841"}]},"ts":"1696006947841"} 2023-09-29 17:02:27,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0e3bb14ffe9acb231bcbcf8cd058d98e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:27,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006947841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006947841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006947841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006947841"}]},"ts":"1696006947841"} 2023-09-29 17:02:27,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-29 17:02:27,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 5d3cd9bae0851b3ba82d9cca3cb4fad8, server=jenkins-hbase4.apache.org,44759,1696006873606 in 171 msec 2023-09-29 17:02:27,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-29 17:02:27,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 0e3bb14ffe9acb231bcbcf8cd058d98e, server=jenkins-hbase4.apache.org,45619,1696006873557 in 171 msec 2023-09-29 17:02:27,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d3cd9bae0851b3ba82d9cca3cb4fad8, ASSIGN in 332 msec 2023-09-29 17:02:27,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-29 17:02:27,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0e3bb14ffe9acb231bcbcf8cd058d98e, ASSIGN in 332 msec 2023-09-29 17:02:27,847 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:02:27,848 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006947847"}]},"ts":"1696006947847"} 2023-09-29 17:02:27,849 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-29 17:02:27,852 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:02:27,852 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-29 17:02:27,854 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-29 17:02:27,856 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:27,856 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:27,856 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:27,856 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:27,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:27,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 383 msec 2023-09-29 17:02:28,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 17:02:28,082 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-29 17:02:28,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 0e3bb14ffe9acb231bcbcf8cd058d98e, 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:28,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0e3bb14ffe9acb231bcbcf8cd058d98e, 5d3cd9bae0851b3ba82d9cca3cb4fad8], force=true 2023-09-29 17:02:28,115 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0e3bb14ffe9acb231bcbcf8cd058d98e, 5d3cd9bae0851b3ba82d9cca3cb4fad8], force=true 2023-09-29 17:02:28,115 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0e3bb14ffe9acb231bcbcf8cd058d98e, 5d3cd9bae0851b3ba82d9cca3cb4fad8], force=true 2023-09-29 17:02:28,115 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0e3bb14ffe9acb231bcbcf8cd058d98e, 5d3cd9bae0851b3ba82d9cca3cb4fad8], force=true 2023-09-29 17:02:28,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 17:02:28,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0e3bb14ffe9acb231bcbcf8cd058d98e, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d3cd9bae0851b3ba82d9cca3cb4fad8, UNASSIGN}] 2023-09-29 17:02:28,140 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0e3bb14ffe9acb231bcbcf8cd058d98e, UNASSIGN 2023-09-29 17:02:28,141 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d3cd9bae0851b3ba82d9cca3cb4fad8, UNASSIGN 2023-09-29 17:02:28,141 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5d3cd9bae0851b3ba82d9cca3cb4fad8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:28,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0e3bb14ffe9acb231bcbcf8cd058d98e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:28,141 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006948141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006948141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006948141"}]},"ts":"1696006948141"} 2023-09-29 17:02:28,142 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006948141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006948141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006948141"}]},"ts":"1696006948141"} 2023-09-29 17:02:28,143 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 5d3cd9bae0851b3ba82d9cca3cb4fad8, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:28,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 0e3bb14ffe9acb231bcbcf8cd058d98e, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:28,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 17:02:28,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:28,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d3cd9bae0851b3ba82d9cca3cb4fad8, disabling compactions & flushes 2023-09-29 17:02:28,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:28,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:28,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. after waiting 0 ms 2023-09-29 17:02:28,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:28,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5d3cd9bae0851b3ba82d9cca3cb4fad8 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-29 17:02:28,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:28,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0e3bb14ffe9acb231bcbcf8cd058d98e, disabling compactions & flushes 2023-09-29 17:02:28,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:28,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:28,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. after waiting 0 ms 2023-09-29 17:02:28,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:28,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0e3bb14ffe9acb231bcbcf8cd058d98e 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-29 17:02:28,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/.tmp/cf/e3c7404ef64245d282f4278d3f848b82 2023-09-29 17:02:28,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/.tmp/cf/4d607c82875447e885bf4bc42e9a7450 2023-09-29 17:02:28,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/.tmp/cf/e3c7404ef64245d282f4278d3f848b82 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf/e3c7404ef64245d282f4278d3f848b82 2023-09-29 17:02:28,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/.tmp/cf/4d607c82875447e885bf4bc42e9a7450 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf/4d607c82875447e885bf4bc42e9a7450 2023-09-29 17:02:28,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf/4d607c82875447e885bf4bc42e9a7450, entries=1, sequenceid=5, filesize=4.7 K 2023-09-29 17:02:28,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf/e3c7404ef64245d282f4278d3f848b82, entries=1, sequenceid=5, filesize=4.7 K 2023-09-29 17:02:28,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0e3bb14ffe9acb231bcbcf8cd058d98e in 22ms, sequenceid=5, compaction requested=false 2023-09-29 17:02:28,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-29 17:02:28,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5d3cd9bae0851b3ba82d9cca3cb4fad8 in 25ms, sequenceid=5, compaction requested=false 2023-09-29 17:02:28,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-29 17:02:28,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-29 17:02:28,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-29 17:02:28,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:28,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:28,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e. 2023-09-29 17:02:28,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8. 2023-09-29 17:02:28,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d3cd9bae0851b3ba82d9cca3cb4fad8: 2023-09-29 17:02:28,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0e3bb14ffe9acb231bcbcf8cd058d98e: 2023-09-29 17:02:28,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:28,335 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5d3cd9bae0851b3ba82d9cca3cb4fad8, regionState=CLOSED 2023-09-29 17:02:28,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:28,336 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006948335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006948335"}]},"ts":"1696006948335"} 2023-09-29 17:02:28,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0e3bb14ffe9acb231bcbcf8cd058d98e, regionState=CLOSED 2023-09-29 17:02:28,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696006948336"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006948336"}]},"ts":"1696006948336"} 2023-09-29 17:02:28,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-29 17:02:28,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 5d3cd9bae0851b3ba82d9cca3cb4fad8, server=jenkins-hbase4.apache.org,44759,1696006873606 in 194 msec 2023-09-29 17:02:28,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-29 17:02:28,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 0e3bb14ffe9acb231bcbcf8cd058d98e, server=jenkins-hbase4.apache.org,45619,1696006873557 in 194 msec 2023-09-29 17:02:28,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d3cd9bae0851b3ba82d9cca3cb4fad8, UNASSIGN in 200 msec 2023-09-29 17:02:28,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-29 17:02:28,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0e3bb14ffe9acb231bcbcf8cd058d98e, UNASSIGN in 204 msec 2023-09-29 17:02:28,386 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-29 17:02:28,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947473.0e3bb14ffe9acb231bcbcf8cd058d98e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:28,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696006947473.5d3cd9bae0851b3ba82d9cca3cb4fad8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:28,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:28,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 17:02:28,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5082e4db0343b3023fe19e7031942da4, ASSIGN}] 2023-09-29 17:02:28,440 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5082e4db0343b3023fe19e7031942da4, ASSIGN 2023-09-29 17:02:28,440 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5082e4db0343b3023fe19e7031942da4, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45619,1696006873557; forceNewPlan=false, retain=false 2023-09-29 17:02:28,591 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-29 17:02:28,593 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5082e4db0343b3023fe19e7031942da4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:28,593 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696006948592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006948592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006948592"}]},"ts":"1696006948592"} 2023-09-29 17:02:28,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 5082e4db0343b3023fe19e7031942da4, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:28,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 17:02:28,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:28,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5082e4db0343b3023fe19e7031942da4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.', STARTKEY => '', ENDKEY => ''} 2023-09-29 17:02:28,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. service=AccessControlService 2023-09-29 17:02:28,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:28,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:28,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:28,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:28,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:28,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/.regioninfo 2023-09-29 17:02:28,760 INFO [StoreOpener-5082e4db0343b3023fe19e7031942da4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:28,761 DEBUG [StoreOpener-5082e4db0343b3023fe19e7031942da4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf 2023-09-29 17:02:28,761 DEBUG [StoreOpener-5082e4db0343b3023fe19e7031942da4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf 2023-09-29 17:02:28,761 INFO [StoreOpener-5082e4db0343b3023fe19e7031942da4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5082e4db0343b3023fe19e7031942da4 columnFamilyName cf 2023-09-29 17:02:28,789 DEBUG [StoreOpener-5082e4db0343b3023fe19e7031942da4-1] regionserver.HStore(539): loaded hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/4d607c82875447e885bf4bc42e9a7450.0e3bb14ffe9acb231bcbcf8cd058d98e->hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf/4d607c82875447e885bf4bc42e9a7450-top 2023-09-29 17:02:28,795 DEBUG [StoreOpener-5082e4db0343b3023fe19e7031942da4-1] regionserver.HStore(539): loaded hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/e3c7404ef64245d282f4278d3f848b82.5d3cd9bae0851b3ba82d9cca3cb4fad8->hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf/e3c7404ef64245d282f4278d3f848b82-top 2023-09-29 17:02:28,795 INFO [StoreOpener-5082e4db0343b3023fe19e7031942da4-1] regionserver.HStore(310): Store=5082e4db0343b3023fe19e7031942da4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:28,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:28,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:28,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:28,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5082e4db0343b3023fe19e7031942da4; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69324316, jitterRate=0.03301280736923218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:28,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5082e4db0343b3023fe19e7031942da4: 2023-09-29 17:02:28,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4., pid=77, masterSystemTime=1696006948746 2023-09-29 17:02:28,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.,because compaction is disabled. 2023-09-29 17:02:28,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:28,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:28,805 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5082e4db0343b3023fe19e7031942da4, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:28,805 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696006948805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006948805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006948805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006948805"}]},"ts":"1696006948805"} 2023-09-29 17:02:28,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-29 17:02:28,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 5082e4db0343b3023fe19e7031942da4, server=jenkins-hbase4.apache.org,45619,1696006873557 in 212 msec 2023-09-29 17:02:28,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-29 17:02:28,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5082e4db0343b3023fe19e7031942da4, ASSIGN in 370 msec 2023-09-29 17:02:28,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0e3bb14ffe9acb231bcbcf8cd058d98e, 5d3cd9bae0851b3ba82d9cca3cb4fad8], force=true in 701 msec 2023-09-29 17:02:29,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 17:02:29,223 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-29 17:02:29,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-29 17:02:29,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006949224 (current time:1696006949224). 2023-09-29 17:02:29,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:02:29,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x2fab7f94 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:29,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a710695, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:29,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:29,235 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:29,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fab7f94 to 127.0.0.1:64917 2023-09-29 17:02:29,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:29,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x641ae9cc to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:29,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10397d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:29,246 DEBUG [hconnection-0x523e8438-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:29,249 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:29,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x641ae9cc to 127.0.0.1:64917 2023-09-29 17:02:29,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:29,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-29 17:02:29,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:02:29,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-29 17:02:29,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-29 17:02:29,258 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-29 17:02:29,259 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696007549259 2023-09-29 17:02:29,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-29 17:02:29,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,262 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:02:29,262 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:02:29,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-29 17:02:29,263 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-29 17:02:29,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-09-29 17:02:29,265 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-29 17:02:29,266 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696007549266 2023-09-29 17:02:29,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,274 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-29 17:02:29,274 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:29,276 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-29 17:02:29,276 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-29 17:02:29,276 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,276 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,278 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:29,278 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:29,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:29,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:29,278 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,278 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:29,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,278 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,278 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:02:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,279 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-29 17:02:29,279 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:29,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,281 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,281 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-29 17:02:29,281 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-29 17:02:29,281 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:29,281 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-29 17:02:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-29 17:02:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-29 17:02:29,281 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-29 17:02:29,283 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-29 17:02:29,283 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-29 17:02:29,283 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-29 17:02:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-29 17:02:29,283 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-29 17:02:29,289 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,289 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:29,289 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,289 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,290 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,290 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:29,289 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:29,290 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:29,290 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,290 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:29,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-29 17:02:29,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7400b36a[Count = 0] remaining members to acquire global barrier 2023-09-29 17:02:29,291 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-29 17:02:29,291 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:02:29,293 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-29 17:02:29,293 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-29 17:02:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:02:29,293 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-29 17:02:29,293 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-29 17:02:29,293 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:02:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,293 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-29 17:02:29,294 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:29,294 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:29,294 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:29,294 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. started... 2023-09-29 17:02:29,295 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5082e4db0343b3023fe19e7031942da4: 2023-09-29 17:02:29,295 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-29 17:02:29,296 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-29 17:02:29,296 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:29,296 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,296 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:29,297 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:29,296 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-29 17:02:29,297 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-29 17:02:29,300 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/4d607c82875447e885bf4bc42e9a7450.0e3bb14ffe9acb231bcbcf8cd058d98e->hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf/4d607c82875447e885bf4bc42e9a7450-top, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/e3c7404ef64245d282f4278d3f848b82.5d3cd9bae0851b3ba82d9cca3cb4fad8->hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf/e3c7404ef64245d282f4278d3f848b82-top] hfiles 2023-09-29 17:02:29,300 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/4d607c82875447e885bf4bc42e9a7450.0e3bb14ffe9acb231bcbcf8cd058d98e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,301 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/e3c7404ef64245d282f4278d3f848b82.5d3cd9bae0851b3ba82d9cca3cb4fad8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,309 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. completed. 2023-09-29 17:02:29,309 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:29,309 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:29,309 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:29,309 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,309 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-29 17:02:29,309 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:02:29,315 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-29 17:02:29,315 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,315 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:29,315 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-29 17:02:29,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:29,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:29,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:29,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:29,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:29,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:02:29,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-29 17:02:29,319 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-29 17:02:29,319 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:02:29,319 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:02:29,319 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,319 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:02:29,320 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,320 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:29,320 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,320 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,321 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:29,321 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:29,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,320 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:29,321 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:29,321 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:29,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:29,322 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:29,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,326 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:29,326 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,327 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,329 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:29,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:29,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:29,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:29,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,330 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:29,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:29,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:29,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:29,330 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:29,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:29,331 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,331 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:29,331 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,331 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:29,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:29,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:29,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:29,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:29,331 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:29,331 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,331 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-29 17:02:29,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,353 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696006949259Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696006949330 (+71 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696006949330Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696006949333 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696006949344 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696006949352 (+8 ms) 2023-09-29 17:02:29,355 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-29 17:02:29,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 94 msec 2023-09-29 17:02:29,363 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:29,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-29 17:02:29,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:02:29,364 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364 2023-09-29 17:02:29,364 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39529, tgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364, rawTgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364, srcFsUri=hdfs://localhost:39529, srcDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:29,396 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:29,396 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1716848598_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,397 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, snapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-29 17:02:29,406 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:29,429 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:29,430 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:29,430 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:29,431 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,309 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-7696687222020588094.jar 2023-09-29 17:02:30,310 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,310 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0004_000001 (auth:SIMPLE) 2023-09-29 17:02:30,382 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-3938424048579338915.jar 2023-09-29 17:02:30,383 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,383 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,383 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,384 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,384 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,384 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:30,385 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 17:02:30,385 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 17:02:30,386 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 17:02:30,386 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 17:02:30,386 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 17:02:30,387 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 17:02:30,387 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 17:02:30,387 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 17:02:30,388 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 17:02:30,388 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 17:02:30,389 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:30,389 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:30,390 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:30,390 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:30,390 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:30,391 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:30,391 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:30,733 WARN [Listener at jenkins-hbase4.apache.org/46659] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 17:02:30,735 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-29 17:02:30,737 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-29 17:02:30,797 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:30,798 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:31,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0005_000001 (auth:SIMPLE) 2023-09-29 17:02:31,381 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:02:35,128 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0005_000001 (auth:SIMPLE) 2023-09-29 17:02:37,344 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0005_000001 (auth:SIMPLE) 2023-09-29 17:02:39,751 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0005_000001 (auth:SIMPLE) 2023-09-29 17:02:40,902 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 17:02:40,905 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 17:02:40,914 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:40,915 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 17:02:40,915 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 17:02:40,915 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:40,916 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-29 17:02:40,916 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-29 17:02:40,916 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:40,917 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-29 17:02:40,917 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006949364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-29 17:02:40,924 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:40,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:40,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:40,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-29 17:02:40,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006960929"}]},"ts":"1696006960929"} 2023-09-29 17:02:40,931 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-29 17:02:40,933 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-29 17:02:40,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5082e4db0343b3023fe19e7031942da4, UNASSIGN}] 2023-09-29 17:02:40,935 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5082e4db0343b3023fe19e7031942da4, UNASSIGN 2023-09-29 17:02:40,936 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5082e4db0343b3023fe19e7031942da4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:40,936 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696006960936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006960936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006960936"}]},"ts":"1696006960936"} 2023-09-29 17:02:40,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 5082e4db0343b3023fe19e7031942da4, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:41,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-29 17:02:41,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:41,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5082e4db0343b3023fe19e7031942da4, disabling compactions & flushes 2023-09-29 17:02:41,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:41,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:41,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. after waiting 0 ms 2023-09-29 17:02:41,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:41,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-29 17:02:41,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:41,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4. 2023-09-29 17:02:41,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5082e4db0343b3023fe19e7031942da4: 2023-09-29 17:02:41,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:41,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5082e4db0343b3023fe19e7031942da4, regionState=CLOSED 2023-09-29 17:02:41,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696006961111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006961111"}]},"ts":"1696006961111"} 2023-09-29 17:02:41,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-29 17:02:41,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 5082e4db0343b3023fe19e7031942da4, server=jenkins-hbase4.apache.org,45619,1696006873557 in 174 msec 2023-09-29 17:02:41,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-29 17:02:41,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5082e4db0343b3023fe19e7031942da4, UNASSIGN in 180 msec 2023-09-29 17:02:41,116 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006961115"}]},"ts":"1696006961115"} 2023-09-29 17:02:41,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-29 17:02:41,123 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-29 17:02:41,125 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 199 msec 2023-09-29 17:02:41,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-29 17:02:41,232 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-29 17:02:41,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,235 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,237 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,240 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,240 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,240 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,240 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,240 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:41,240 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:41,240 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:41,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-29 17:02:41,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-29 17:02:41,241 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,241 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-29 17:02:41,241 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,242 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,242 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,242 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,242 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 17:02:41,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-29 17:02:41,242 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 17:02:41,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:41,243 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/recovered.edits] 2023-09-29 17:02:41,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:41,243 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/recovered.edits] 2023-09-29 17:02:41,244 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/recovered.edits] 2023-09-29 17:02:41,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-29 17:02:41,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:41,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:41,249 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/4d607c82875447e885bf4bc42e9a7450.0e3bb14ffe9acb231bcbcf8cd058d98e to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/4d607c82875447e885bf4bc42e9a7450.0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:41,249 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf/e3c7404ef64245d282f4278d3f848b82 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/cf/e3c7404ef64245d282f4278d3f848b82 2023-09-29 17:02:41,249 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf/4d607c82875447e885bf4bc42e9a7450 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/cf/4d607c82875447e885bf4bc42e9a7450 2023-09-29 17:02:41,250 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/e3c7404ef64245d282f4278d3f848b82.5d3cd9bae0851b3ba82d9cca3cb4fad8 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/cf/e3c7404ef64245d282f4278d3f848b82.5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:41,253 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/recovered.edits/8.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8/recovered.edits/8.seqid 2023-09-29 17:02:41,254 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/recovered.edits/8.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e/recovered.edits/8.seqid 2023-09-29 17:02:41,254 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d3cd9bae0851b3ba82d9cca3cb4fad8 2023-09-29 17:02:41,254 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0e3bb14ffe9acb231bcbcf8cd058d98e 2023-09-29 17:02:41,255 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/recovered.edits/12.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4/recovered.edits/12.seqid 2023-09-29 17:02:41,255 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5082e4db0343b3023fe19e7031942da4 2023-09-29 17:02:41,255 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-29 17:02:41,257 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,260 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-29 17:02:41,262 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-29 17:02:41,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-29 17:02:41,263 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006961263"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:41,265 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-29 17:02:41,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5082e4db0343b3023fe19e7031942da4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696006947474.5082e4db0343b3023fe19e7031942da4.', STARTKEY => '', ENDKEY => ''}] 2023-09-29 17:02:41,265 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-29 17:02:41,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696006961265"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:41,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-29 17:02:41,270 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 38 msec 2023-09-29 17:02:41,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-29 17:02:41,347 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-29 17:02:41,348 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-29 17:02:41,352 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006961352"}]},"ts":"1696006961352"} 2023-09-29 17:02:41,354 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-29 17:02:41,355 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-29 17:02:41,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=339eb74e50ed1fd56b5c9701a8e5b494, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c10a3499ed25c6f5e993677e956fc9df, UNASSIGN}] 2023-09-29 17:02:41,358 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=339eb74e50ed1fd56b5c9701a8e5b494, UNASSIGN 2023-09-29 17:02:41,358 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c10a3499ed25c6f5e993677e956fc9df, UNASSIGN 2023-09-29 17:02:41,359 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c10a3499ed25c6f5e993677e956fc9df, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:41,359 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=339eb74e50ed1fd56b5c9701a8e5b494, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:41,359 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006961359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006961359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006961359"}]},"ts":"1696006961359"} 2023-09-29 17:02:41,359 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006961359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006961359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006961359"}]},"ts":"1696006961359"} 2023-09-29 17:02:41,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure c10a3499ed25c6f5e993677e956fc9df, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:41,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 339eb74e50ed1fd56b5c9701a8e5b494, server=jenkins-hbase4.apache.org,44811,1696006873656}] 2023-09-29 17:02:41,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-29 17:02:41,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:41,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c10a3499ed25c6f5e993677e956fc9df, disabling compactions & flushes 2023-09-29 17:02:41,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:41,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:41,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. after waiting 0 ms 2023-09-29 17:02:41,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:41,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:41,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 339eb74e50ed1fd56b5c9701a8e5b494, disabling compactions & flushes 2023-09-29 17:02:41,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:41,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:41,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. after waiting 0 ms 2023-09-29 17:02:41,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:41,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:02:41,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:02:41,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:41,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:41,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df. 2023-09-29 17:02:41,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c10a3499ed25c6f5e993677e956fc9df: 2023-09-29 17:02:41,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494. 2023-09-29 17:02:41,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 339eb74e50ed1fd56b5c9701a8e5b494: 2023-09-29 17:02:41,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:41,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c10a3499ed25c6f5e993677e956fc9df, regionState=CLOSED 2023-09-29 17:02:41,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006961531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006961531"}]},"ts":"1696006961531"} 2023-09-29 17:02:41,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:41,531 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=339eb74e50ed1fd56b5c9701a8e5b494, regionState=CLOSED 2023-09-29 17:02:41,532 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696006961531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006961531"}]},"ts":"1696006961531"} 2023-09-29 17:02:41,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-29 17:02:41,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure c10a3499ed25c6f5e993677e956fc9df, server=jenkins-hbase4.apache.org,44759,1696006873606 in 171 msec 2023-09-29 17:02:41,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-29 17:02:41,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 339eb74e50ed1fd56b5c9701a8e5b494, server=jenkins-hbase4.apache.org,44811,1696006873656 in 172 msec 2023-09-29 17:02:41,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c10a3499ed25c6f5e993677e956fc9df, UNASSIGN in 178 msec 2023-09-29 17:02:41,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-29 17:02:41,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=339eb74e50ed1fd56b5c9701a8e5b494, UNASSIGN in 179 msec 2023-09-29 17:02:41,537 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006961537"}]},"ts":"1696006961537"} 2023-09-29 17:02:41,538 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-29 17:02:41,540 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-29 17:02:41,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 192 msec 2023-09-29 17:02:41,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-29 17:02:41,655 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-29 17:02:41,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,658 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,659 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,660 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,663 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:41,663 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:41,664 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,664 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,664 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,664 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-29 17:02:41,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-29 17:02:41,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-29 17:02:41,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,666 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/recovered.edits] 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,666 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:41,666 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/recovered.edits] 2023-09-29 17:02:41,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-29 17:02:41,692 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf/d5983bf5f64843d9a22144468097fd7f to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/cf/d5983bf5f64843d9a22144468097fd7f 2023-09-29 17:02:41,692 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf/462a08454a074f218bc36f10dbdc036a to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/cf/462a08454a074f218bc36f10dbdc036a 2023-09-29 17:02:41,699 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494/recovered.edits/9.seqid 2023-09-29 17:02:41,699 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df/recovered.edits/9.seqid 2023-09-29 17:02:41,700 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/339eb74e50ed1fd56b5c9701a8e5b494 2023-09-29 17:02:41,700 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c10a3499ed25c6f5e993677e956fc9df 2023-09-29 17:02:41,700 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-29 17:02:41,700 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-29 17:02:41,701 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-29 17:02:41,704 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230929595580b27fa64a1fac9b17f9e3bf0f58 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230929595580b27fa64a1fac9b17f9e3bf0f58 2023-09-29 17:02:41,706 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929b761b5a8d00c42b4bf5a3a8764aa22cb to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929b761b5a8d00c42b4bf5a3a8764aa22cb 2023-09-29 17:02:41,706 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-29 17:02:41,709 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,711 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-29 17:02:41,712 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-29 17:02:41,713 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-29 17:02:41,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006961714"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:41,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006961714"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:41,715 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 17:02:41,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 339eb74e50ed1fd56b5c9701a8e5b494, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696006946105.339eb74e50ed1fd56b5c9701a8e5b494.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c10a3499ed25c6f5e993677e956fc9df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696006946105.c10a3499ed25c6f5e993677e956fc9df.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 17:02:41,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-29 17:02:41,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696006961715"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:41,717 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-29 17:02:41,718 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 62 msec 2023-09-29 17:02:41,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-29 17:02:41,768 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-29 17:02:41,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-29 17:02:41,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-29 17:02:41,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 17:02:41,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-29 17:02:41,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 17:02:41,809 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 747) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:35884 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:36070 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:60922 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-544207691_1 at /127.0.0.1:35860 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3959 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:42091 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:46659 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=305 (was 322), ProcessCount=168 (was 168), AvailableMemoryMB=840 (was 898) 2023-09-29 17:02:41,809 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-29 17:02:41,829 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=168, AvailableMemoryMB=839 2023-09-29 17:02:41,829 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-29 17:02:41,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 17:02:41,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:41,834 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:02:41,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-29 17:02:41,835 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:02:41,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 17:02:41,837 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:41,837 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:41,838 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d empty. 2023-09-29 17:02:41,838 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21 empty. 2023-09-29 17:02:41,838 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:41,838 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:41,838 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-29 17:02:41,847 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-29 17:02:41,849 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d5c5f0addd44e95949a7a28ef99b2d21, NAME => 'testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:41,849 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2bae29abddb1a9d2c3bd8398635c206d, NAME => 'testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2bae29abddb1a9d2c3bd8398635c206d, disabling compactions & flushes 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d5c5f0addd44e95949a7a28ef99b2d21, disabling compactions & flushes 2023-09-29 17:02:41,857 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:41,857 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. after waiting 0 ms 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. after waiting 0 ms 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:41,857 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:41,857 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2bae29abddb1a9d2c3bd8398635c206d: 2023-09-29 17:02:41,857 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d5c5f0addd44e95949a7a28ef99b2d21: 2023-09-29 17:02:41,860 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:02:41,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006961860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006961860"}]},"ts":"1696006961860"} 2023-09-29 17:02:41,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006961860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006961860"}]},"ts":"1696006961860"} 2023-09-29 17:02:41,862 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 17:02:41,863 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:02:41,863 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006961863"}]},"ts":"1696006961863"} 2023-09-29 17:02:41,865 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-29 17:02:41,869 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:02:41,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:02:41,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:02:41,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:02:41,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:02:41,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2bae29abddb1a9d2c3bd8398635c206d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5c5f0addd44e95949a7a28ef99b2d21, ASSIGN}] 2023-09-29 17:02:41,873 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5c5f0addd44e95949a7a28ef99b2d21, ASSIGN 2023-09-29 17:02:41,873 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2bae29abddb1a9d2c3bd8398635c206d, ASSIGN 2023-09-29 17:02:41,874 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5c5f0addd44e95949a7a28ef99b2d21, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44759,1696006873606; forceNewPlan=false, retain=false 2023-09-29 17:02:41,874 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2bae29abddb1a9d2c3bd8398635c206d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45619,1696006873557; forceNewPlan=false, retain=false 2023-09-29 17:02:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 17:02:42,024 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 17:02:42,027 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2bae29abddb1a9d2c3bd8398635c206d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,027 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d5c5f0addd44e95949a7a28ef99b2d21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,027 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006962027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006962027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006962027"}]},"ts":"1696006962027"} 2023-09-29 17:02:42,027 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006962027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006962027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006962027"}]},"ts":"1696006962027"} 2023-09-29 17:02:42,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 2bae29abddb1a9d2c3bd8398635c206d, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:42,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure d5c5f0addd44e95949a7a28ef99b2d21, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:42,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 17:02:42,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:42,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5c5f0addd44e95949a7a28ef99b2d21, NAME => 'testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2bae29abddb1a9d2c3bd8398635c206d, NAME => 'testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. service=AccessControlService 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. service=AccessControlService 2023-09-29 17:02:42,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:42,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:42,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:42,188 INFO [StoreOpener-2bae29abddb1a9d2c3bd8398635c206d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:42,188 INFO [StoreOpener-d5c5f0addd44e95949a7a28ef99b2d21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:42,190 DEBUG [StoreOpener-d5c5f0addd44e95949a7a28ef99b2d21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf 2023-09-29 17:02:42,190 DEBUG [StoreOpener-2bae29abddb1a9d2c3bd8398635c206d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf 2023-09-29 17:02:42,190 DEBUG [StoreOpener-2bae29abddb1a9d2c3bd8398635c206d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf 2023-09-29 17:02:42,190 DEBUG [StoreOpener-d5c5f0addd44e95949a7a28ef99b2d21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf 2023-09-29 17:02:42,190 INFO [StoreOpener-d5c5f0addd44e95949a7a28ef99b2d21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5c5f0addd44e95949a7a28ef99b2d21 columnFamilyName cf 2023-09-29 17:02:42,190 INFO [StoreOpener-2bae29abddb1a9d2c3bd8398635c206d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2bae29abddb1a9d2c3bd8398635c206d columnFamilyName cf 2023-09-29 17:02:42,191 INFO [StoreOpener-d5c5f0addd44e95949a7a28ef99b2d21-1] regionserver.HStore(310): Store=d5c5f0addd44e95949a7a28ef99b2d21/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:42,191 INFO [StoreOpener-2bae29abddb1a9d2c3bd8398635c206d-1] regionserver.HStore(310): Store=2bae29abddb1a9d2c3bd8398635c206d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:42,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:42,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:42,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:42,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:42,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:42,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:42,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5c5f0addd44e95949a7a28ef99b2d21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69545074, jitterRate=0.0363023579120636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:42,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:42,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5c5f0addd44e95949a7a28ef99b2d21: 2023-09-29 17:02:42,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21., pid=94, masterSystemTime=1696006962183 2023-09-29 17:02:42,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:42,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:42,200 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d5c5f0addd44e95949a7a28ef99b2d21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2bae29abddb1a9d2c3bd8398635c206d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69668163, jitterRate=0.03813652694225311}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:42,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006962200"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006962200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006962200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006962200"}]},"ts":"1696006962200"} 2023-09-29 17:02:42,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2bae29abddb1a9d2c3bd8398635c206d: 2023-09-29 17:02:42,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d., pid=93, masterSystemTime=1696006962183 2023-09-29 17:02:42,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2bae29abddb1a9d2c3bd8398635c206d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006962203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006962203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006962203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006962203"}]},"ts":"1696006962203"} 2023-09-29 17:02:42,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-29 17:02:42,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure d5c5f0addd44e95949a7a28ef99b2d21, server=jenkins-hbase4.apache.org,44759,1696006873606 in 173 msec 2023-09-29 17:02:42,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5c5f0addd44e95949a7a28ef99b2d21, ASSIGN in 333 msec 2023-09-29 17:02:42,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-29 17:02:42,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 2bae29abddb1a9d2c3bd8398635c206d, server=jenkins-hbase4.apache.org,45619,1696006873557 in 176 msec 2023-09-29 17:02:42,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-29 17:02:42,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2bae29abddb1a9d2c3bd8398635c206d, ASSIGN in 336 msec 2023-09-29 17:02:42,208 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:02:42,208 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006962208"}]},"ts":"1696006962208"} 2023-09-29 17:02:42,209 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-29 17:02:42,211 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:02:42,211 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-29 17:02:42,213 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 17:02:42,214 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:42,214 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:42,214 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:42,214 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:42,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:42,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:42,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:42,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:42,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 385 msec 2023-09-29 17:02:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 17:02:42,440 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-29 17:02:42,442 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-29 17:02:42,442 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,444 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:02:42,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:02:42,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006962454 (current time:1696006962454). 2023-09-29 17:02:42,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:02:42,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x5e12df76 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:42,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57429fd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:42,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:42,469 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:42,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e12df76 to 127.0.0.1:64917 2023-09-29 17:02:42,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:42,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x232f6459 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:42,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b8ee625, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:42,478 DEBUG [hconnection-0x28f15080-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:42,479 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:42,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x232f6459 to 127.0.0.1:64917 2023-09-29 17:02:42,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:42,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 17:02:42,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:02:42,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:02:42,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:02:42,488 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:02:42,489 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696007562489 2023-09-29 17:02:42,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-29 17:02:42,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:02:42,490 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:02:42,490 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:02:42,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 17:02:42,491 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:02:42,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-29 17:02:42,496 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 17:02:42,496 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696007562496 2023-09-29 17:02:42,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,505 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-29 17:02:42,505 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,506 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-29 17:02:42,506 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-29 17:02:42,507 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,507 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,513 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,513 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,513 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,513 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,514 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,514 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,514 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,514 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:02:42,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 17:02:42,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 17:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 17:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,517 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 17:02:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 17:02:42,515 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 17:02:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 17:02:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 17:02:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 17:02:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 17:02:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 17:02:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 17:02:42,520 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,520 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,522 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,522 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,524 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 17:02:42,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 1] remaining members to acquire global barrier 2023-09-29 17:02:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 17:02:42,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 0] remaining members to acquire global barrier 2023-09-29 17:02:42,527 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 17:02:42,528 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,530 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,530 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,530 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,531 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:02:42,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:02:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,531 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,531 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:02:42,531 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:42,531 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. started... 2023-09-29 17:02:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:42,532 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:42,532 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,533 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5c5f0addd44e95949a7a28ef99b2d21: 2023-09-29 17:02:42,533 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. started... 2023-09-29 17:02:42,533 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,533 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2bae29abddb1a9d2c3bd8398635c206d: 2023-09-29 17:02:42,533 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:42,534 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:02:42,534 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,534 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:42,534 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:02:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 17:02:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 17:02:42,547 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. completed. 2023-09-29 17:02:42,547 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:42,547 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:42,547 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:42,547 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,547 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 17:02:42,547 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:02:42,549 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 17:02:42,549 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,549 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,549 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 17:02:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,549 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. completed. 2023-09-29 17:02:42,551 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,551 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:42,551 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:42,551 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,551 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 17:02:42,551 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:02:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,553 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 17:02:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,553 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,553 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,553 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 17:02:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 17:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:02:42,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 17:02:42,559 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-29 17:02:42,559 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:02:42,559 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:02:42,559 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,559 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:02:42,562 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,562 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,562 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,563 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,564 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,565 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,565 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,566 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,568 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,568 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,568 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,568 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,568 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,568 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,568 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,568 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,570 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-29 17:02:42,569 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,570 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:02:42,571 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,571 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,571 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,571 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,571 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,571 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,571 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 17:02:42,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,590 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:42,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:02:42,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:02:42,592 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:02:42,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-29 17:02:42,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,599 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696006962489Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696006962579 (+90 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696006962579Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696006962579Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696006962582 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696006962589 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696006962599 (+10 ms) 2023-09-29 17:02:42,603 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 17:02:42,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 113 msec 2023-09-29 17:02:42,792 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:42,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:02:42,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:02:42,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45619] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:02:42,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44759] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:02:42,799 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-29 17:02:42,799 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,799 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:02:42,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:02:42,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006962809 (current time:1696006962809). 2023-09-29 17:02:42,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:02:42,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x365bd8ea to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140cebf1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:42,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:42,819 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:42,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x365bd8ea to 127.0.0.1:64917 2023-09-29 17:02:42,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:42,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x6151efab to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:42,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9a5f7e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:42,828 DEBUG [hconnection-0x7a05c645-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:42,830 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:42,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6151efab to 127.0.0.1:64917 2023-09-29 17:02:42,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:42,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 17:02:42,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:02:42,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:02:42,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:02:42,838 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:02:42,839 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696007562839 2023-09-29 17:02:42,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 17:02:42,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-29 17:02:42,840 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:02:42,840 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:02:42,844 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 17:02:42,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 17:02:42,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-29 17:02:42,845 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 17:02:42,846 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696007562846 2023-09-29 17:02:42,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,854 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-29 17:02:42,854 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,855 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-29 17:02:42,855 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-29 17:02:42,856 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,856 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,857 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,857 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,857 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,857 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,857 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,858 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,858 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,858 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 17:02:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 17:02:42,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 17:02:42,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 17:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 17:02:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 17:02:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 17:02:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:42,860 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 17:02:42,864 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 17:02:42,864 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 17:02:42,864 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 17:02:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 17:02:42,864 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 17:02:42,865 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 17:02:42,866 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,866 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,866 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,866 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc9d531[Count = 1] remaining members to acquire global barrier 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 17:02:42,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc9d531[Count = 0] remaining members to acquire global barrier 2023-09-29 17:02:42,872 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 17:02:42,872 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,875 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,876 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:02:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:42,876 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 17:02:42,876 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:42,876 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:02:42,876 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:42,876 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. started... 2023-09-29 17:02:42,876 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. started... 2023-09-29 17:02:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:02:42,877 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2bae29abddb1a9d2c3bd8398635c206d 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-29 17:02:42,877 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d5c5f0addd44e95949a7a28ef99b2d21 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-29 17:02:42,878 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 17:02:42,878 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,878 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 17:02:42,898 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230929e87033a208454c70a8e210a4aecd6a4c to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230929e87033a208454c70a8e210a4aecd6a4c 2023-09-29 17:02:42,899 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230929e42d0c016002470a9cbb8440fca87be3 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929e42d0c016002470a9cbb8440fca87be3 2023-09-29 17:02:42,906 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/.tmp/cf/197877dee88447a8a5cb1a30dff6a720 2023-09-29 17:02:42,907 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/.tmp/cf/25627a2d6b0646faa76f007caf7e6c66 2023-09-29 17:02:42,912 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/.tmp/cf/197877dee88447a8a5cb1a30dff6a720 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf/197877dee88447a8a5cb1a30dff6a720 2023-09-29 17:02:42,912 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/.tmp/cf/25627a2d6b0646faa76f007caf7e6c66 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf/25627a2d6b0646faa76f007caf7e6c66 2023-09-29 17:02:42,916 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf/197877dee88447a8a5cb1a30dff6a720, entries=48, sequenceid=6, filesize=13.2 K 2023-09-29 17:02:42,917 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf/25627a2d6b0646faa76f007caf7e6c66, entries=2, sequenceid=6, filesize=5.2 K 2023-09-29 17:02:42,917 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d5c5f0addd44e95949a7a28ef99b2d21 in 40ms, sequenceid=6, compaction requested=false 2023-09-29 17:02:42,917 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-29 17:02:42,918 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 2bae29abddb1a9d2c3bd8398635c206d in 41ms, sequenceid=6, compaction requested=false 2023-09-29 17:02:42,918 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-29 17:02:42,920 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2bae29abddb1a9d2c3bd8398635c206d: 2023-09-29 17:02:42,920 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5c5f0addd44e95949a7a28ef99b2d21: 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf/25627a2d6b0646faa76f007caf7e6c66] hfiles 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf/25627a2d6b0646faa76f007caf7e6c66 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf/197877dee88447a8a5cb1a30dff6a720] hfiles 2023-09-29 17:02:42,921 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf/197877dee88447a8a5cb1a30dff6a720 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,929 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. completed. 2023-09-29 17:02:42,929 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. completed. 2023-09-29 17:02:42,929 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:42,929 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:02:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:02:42,931 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,931 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,931 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 17:02:42,931 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 17:02:42,931 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,931 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 17:02:42,931 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,933 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 17:02:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:02:42,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 17:02:42,940 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-29 17:02:42,940 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:02:42,940 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:02:42,940 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,940 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:02:42,940 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:42,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:02:42,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:02:42,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:42,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:02:42,941 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:42,942 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,942 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,943 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:42,943 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:42,945 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,945 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,945 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:42,948 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,949 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:42,949 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:42,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,948 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:42,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:02:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:42,949 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:42,951 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,951 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:42,951 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:42,951 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,951 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:42,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230929e87033a208454c70a8e210a4aecd6a4c, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929e42d0c016002470a9cbb8440fca87be3] mob files 2023-09-29 17:02:42,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230929e87033a208454c70a8e210a4aecd6a4c 2023-09-29 17:02:42,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929e42d0c016002470a9cbb8440fca87be3 2023-09-29 17:02:42,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,975 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-29 17:02:42,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,975 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:42,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696006962839Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696006962958 (+119 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696006962958Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696006962958Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696006962961 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696006962968 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696006962975 (+7 ms) 2023-09-29 17:02:42,978 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 17:02:42,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 138 msec 2023-09-29 17:02:43,142 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:43,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 17:02:43,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:02:43,143 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143 2023-09-29 17:02:43,143 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39529, tgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143, rawTgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143, srcFsUri=hdfs://localhost:39529, srcDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:43,165 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:43,165 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1051935700_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:43,165 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, snapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-29 17:02:43,171 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:43,188 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:43,188 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:43,189 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:43,189 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,066 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-3413527676694553413.jar 2023-09-29 17:02:44,067 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,067 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,134 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-2430191009533775993.jar 2023-09-29 17:02:44,134 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,135 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,135 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,135 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,136 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,136 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:44,136 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 17:02:44,137 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 17:02:44,137 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 17:02:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 17:02:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 17:02:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 17:02:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 17:02:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 17:02:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 17:02:44,140 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 17:02:44,140 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:44,141 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:44,141 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:44,142 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:44,142 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:44,142 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:44,143 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:44,516 WARN [Listener at jenkins-hbase4.apache.org/46659] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 17:02:44,518 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-29 17:02:45,929 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:45,929 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:45,932 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0005_000001 (auth:SIMPLE) 2023-09-29 17:02:46,368 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0006_000001 (auth:SIMPLE) 2023-09-29 17:02:46,691 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:02:50,170 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0006_000001 (auth:SIMPLE) 2023-09-29 17:02:52,856 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 17:02:52,857 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 17:02:52,862 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:52,862 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 17:02:52,863 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 17:02:52,863 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:52,863 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-29 17:02:52,864 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-29 17:02:52,864 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:52,864 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-29 17:02:52,864 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006963143/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-29 17:02:52,870 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-29 17:02:52,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-29 17:02:52,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:52,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-29 17:02:52,875 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006972875"}]},"ts":"1696006972875"} 2023-09-29 17:02:52,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-29 17:02:52,878 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-29 17:02:52,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2bae29abddb1a9d2c3bd8398635c206d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5c5f0addd44e95949a7a28ef99b2d21, UNASSIGN}] 2023-09-29 17:02:52,881 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2bae29abddb1a9d2c3bd8398635c206d, UNASSIGN 2023-09-29 17:02:52,881 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5c5f0addd44e95949a7a28ef99b2d21, UNASSIGN 2023-09-29 17:02:52,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2bae29abddb1a9d2c3bd8398635c206d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:52,882 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d5c5f0addd44e95949a7a28ef99b2d21, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:52,882 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006972882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006972882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006972882"}]},"ts":"1696006972882"} 2023-09-29 17:02:52,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006972882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006972882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006972882"}]},"ts":"1696006972882"} 2023-09-29 17:02:52,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure d5c5f0addd44e95949a7a28ef99b2d21, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:52,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 2bae29abddb1a9d2c3bd8398635c206d, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:52,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-29 17:02:53,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:53,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5c5f0addd44e95949a7a28ef99b2d21, disabling compactions & flushes 2023-09-29 17:02:53,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:53,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:53,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. after waiting 0 ms 2023-09-29 17:02:53,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:53,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:53,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2bae29abddb1a9d2c3bd8398635c206d, disabling compactions & flushes 2023-09-29 17:02:53,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:53,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:53,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. after waiting 0 ms 2023-09-29 17:02:53,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:53,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:02:53,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:53,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21. 2023-09-29 17:02:53,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:02:53,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5c5f0addd44e95949a7a28ef99b2d21: 2023-09-29 17:02:53,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:02:53,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d. 2023-09-29 17:02:53,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2bae29abddb1a9d2c3bd8398635c206d: 2023-09-29 17:02:53,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:53,050 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d5c5f0addd44e95949a7a28ef99b2d21, regionState=CLOSED 2023-09-29 17:02:53,050 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006973050"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006973050"}]},"ts":"1696006973050"} 2023-09-29 17:02:53,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:53,050 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2bae29abddb1a9d2c3bd8398635c206d, regionState=CLOSED 2023-09-29 17:02:53,050 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696006973050"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006973050"}]},"ts":"1696006973050"} 2023-09-29 17:02:53,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-29 17:02:53,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure d5c5f0addd44e95949a7a28ef99b2d21, server=jenkins-hbase4.apache.org,44759,1696006873606 in 167 msec 2023-09-29 17:02:53,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-29 17:02:53,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 2bae29abddb1a9d2c3bd8398635c206d, server=jenkins-hbase4.apache.org,45619,1696006873557 in 167 msec 2023-09-29 17:02:53,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5c5f0addd44e95949a7a28ef99b2d21, UNASSIGN in 174 msec 2023-09-29 17:02:53,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-29 17:02:53,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2bae29abddb1a9d2c3bd8398635c206d, UNASSIGN in 175 msec 2023-09-29 17:02:53,055 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006973055"}]},"ts":"1696006973055"} 2023-09-29 17:02:53,057 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-29 17:02:53,058 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-29 17:02:53,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 188 msec 2023-09-29 17:02:53,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-29 17:02:53,178 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-29 17:02:53,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,181 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,182 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,184 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,186 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:53,186 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:53,187 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,187 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,187 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,187 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 17:02:53,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 17:02:53,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 17:02:53,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 17:02:53,188 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/recovered.edits] 2023-09-29 17:02:53,188 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/recovered.edits] 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,189 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-29 17:02:53,192 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf/25627a2d6b0646faa76f007caf7e6c66 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/cf/25627a2d6b0646faa76f007caf7e6c66 2023-09-29 17:02:53,193 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf/197877dee88447a8a5cb1a30dff6a720 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/cf/197877dee88447a8a5cb1a30dff6a720 2023-09-29 17:02:53,196 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21/recovered.edits/9.seqid 2023-09-29 17:02:53,196 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d/recovered.edits/9.seqid 2023-09-29 17:02:53,197 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5c5f0addd44e95949a7a28ef99b2d21 2023-09-29 17:02:53,197 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2bae29abddb1a9d2c3bd8398635c206d 2023-09-29 17:02:53,197 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-29 17:02:53,197 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-29 17:02:53,198 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-29 17:02:53,202 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230929e87033a208454c70a8e210a4aecd6a4c to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230929e87033a208454c70a8e210a4aecd6a4c 2023-09-29 17:02:53,203 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929e42d0c016002470a9cbb8440fca87be3 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929e42d0c016002470a9cbb8440fca87be3 2023-09-29 17:02:53,203 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-29 17:02:53,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,207 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-29 17:02:53,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-29 17:02:53,210 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,210 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-29 17:02:53,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006973210"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:53,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006973210"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:53,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 17:02:53,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2bae29abddb1a9d2c3bd8398635c206d, NAME => 'testtb-testEmptyExportFileSystemState,,1696006961831.2bae29abddb1a9d2c3bd8398635c206d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d5c5f0addd44e95949a7a28ef99b2d21, NAME => 'testtb-testEmptyExportFileSystemState,1,1696006961831.d5c5f0addd44e95949a7a28ef99b2d21.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 17:02:53,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-29 17:02:53,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696006973212"}]},"ts":"9223372036854775807"} 2023-09-29 17:02:53,214 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-29 17:02:53,216 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 17:02:53,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 37 msec 2023-09-29 17:02:53,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-29 17:02:53,291 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-29 17:02:53,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-29 17:02:53,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:53,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-29 17:02:53,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-29 17:02:53,327 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 760) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:43481 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:48922 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-85488290_1 at /127.0.0.1:52538 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:46657 from appattempt_1696006880214_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:45237 from appattempt_1696006880214_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4611 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-85488290_1 at /127.0.0.1:48910 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d53de13-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-975241179_17 at /127.0.0.1:52566 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 305), ProcessCount=167 (was 168), AvailableMemoryMB=818 (was 839) 2023-09-29 17:02:53,328 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-29 17:02:53,348 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=167, AvailableMemoryMB=818 2023-09-29 17:02:53,348 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-29 17:02:53,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 17:02:53,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:53,353 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 17:02:53,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-29 17:02:53,354 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 17:02:53,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 17:02:53,356 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,356 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,357 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843 empty. 2023-09-29 17:02:53,357 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85 empty. 2023-09-29 17:02:53,358 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,358 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,358 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-29 17:02:53,367 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-29 17:02:53,368 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 987f37cb50410d9f1a54a84207b04a85, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:53,368 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c44e17cded9f1fd84080059a7e32843, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp 2023-09-29 17:02:53,393 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:53,393 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 987f37cb50410d9f1a54a84207b04a85, disabling compactions & flushes 2023-09-29 17:02:53,393 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:53,393 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:53,393 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. after waiting 0 ms 2023-09-29 17:02:53,394 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:53,394 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:53,394 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 987f37cb50410d9f1a54a84207b04a85: 2023-09-29 17:02:53,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:53,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 9c44e17cded9f1fd84080059a7e32843, disabling compactions & flushes 2023-09-29 17:02:53,396 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. after waiting 0 ms 2023-09-29 17:02:53,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,396 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 9c44e17cded9f1fd84080059a7e32843: 2023-09-29 17:02:53,398 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 17:02:53,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006973399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006973399"}]},"ts":"1696006973399"} 2023-09-29 17:02:53,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006973399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006973399"}]},"ts":"1696006973399"} 2023-09-29 17:02:53,401 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 17:02:53,402 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 17:02:53,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006973402"}]},"ts":"1696006973402"} 2023-09-29 17:02:53,403 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-29 17:02:53,407 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 17:02:53,408 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 17:02:53,408 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 17:02:53,408 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 17:02:53,409 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 17:02:53,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c44e17cded9f1fd84080059a7e32843, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=987f37cb50410d9f1a54a84207b04a85, ASSIGN}] 2023-09-29 17:02:53,412 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c44e17cded9f1fd84080059a7e32843, ASSIGN 2023-09-29 17:02:53,412 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=987f37cb50410d9f1a54a84207b04a85, ASSIGN 2023-09-29 17:02:53,412 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c44e17cded9f1fd84080059a7e32843, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44759,1696006873606; forceNewPlan=false, retain=false 2023-09-29 17:02:53,412 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=987f37cb50410d9f1a54a84207b04a85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45619,1696006873557; forceNewPlan=false, retain=false 2023-09-29 17:02:53,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 17:02:53,563 INFO [jenkins-hbase4:45867] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 17:02:53,565 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9c44e17cded9f1fd84080059a7e32843, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:53,565 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=987f37cb50410d9f1a54a84207b04a85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:53,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006973565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006973565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006973565"}]},"ts":"1696006973565"} 2023-09-29 17:02:53,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006973565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006973565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006973565"}]},"ts":"1696006973565"} 2023-09-29 17:02:53,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 9c44e17cded9f1fd84080059a7e32843, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:02:53,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 987f37cb50410d9f1a54a84207b04a85, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:02:53,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 17:02:53,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:53,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 987f37cb50410d9f1a54a84207b04a85, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c44e17cded9f1fd84080059a7e32843, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. service=AccessControlService 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. service=AccessControlService 2023-09-29 17:02:53,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:53,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 17:02:53,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,725 INFO [StoreOpener-9c44e17cded9f1fd84080059a7e32843-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,728 INFO [StoreOpener-987f37cb50410d9f1a54a84207b04a85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,728 DEBUG [StoreOpener-9c44e17cded9f1fd84080059a7e32843-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf 2023-09-29 17:02:53,729 DEBUG [StoreOpener-9c44e17cded9f1fd84080059a7e32843-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf 2023-09-29 17:02:53,729 INFO [StoreOpener-9c44e17cded9f1fd84080059a7e32843-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c44e17cded9f1fd84080059a7e32843 columnFamilyName cf 2023-09-29 17:02:53,729 DEBUG [StoreOpener-987f37cb50410d9f1a54a84207b04a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf 2023-09-29 17:02:53,729 DEBUG [StoreOpener-987f37cb50410d9f1a54a84207b04a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf 2023-09-29 17:02:53,729 INFO [StoreOpener-987f37cb50410d9f1a54a84207b04a85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 987f37cb50410d9f1a54a84207b04a85 columnFamilyName cf 2023-09-29 17:02:53,730 INFO [StoreOpener-9c44e17cded9f1fd84080059a7e32843-1] regionserver.HStore(310): Store=9c44e17cded9f1fd84080059a7e32843/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:53,730 INFO [StoreOpener-987f37cb50410d9f1a54a84207b04a85-1] regionserver.HStore(310): Store=987f37cb50410d9f1a54a84207b04a85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 17:02:53,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:02:53,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:02:53,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:53,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 17:02:53,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c44e17cded9f1fd84080059a7e32843; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61006203, jitterRate=-0.09093673527240753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:53,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c44e17cded9f1fd84080059a7e32843: 2023-09-29 17:02:53,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 987f37cb50410d9f1a54a84207b04a85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60543303, jitterRate=-0.09783448278903961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 17:02:53,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 987f37cb50410d9f1a54a84207b04a85: 2023-09-29 17:02:53,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843., pid=108, masterSystemTime=1696006973719 2023-09-29 17:02:53,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85., pid=109, masterSystemTime=1696006973719 2023-09-29 17:02:53,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,739 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9c44e17cded9f1fd84080059a7e32843, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:53,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:53,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:53,739 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006973739"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006973739"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006973739"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006973739"}]},"ts":"1696006973739"} 2023-09-29 17:02:53,739 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=987f37cb50410d9f1a54a84207b04a85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:53,739 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006973739"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696006973739"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696006973739"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696006973739"}]},"ts":"1696006973739"} 2023-09-29 17:02:53,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-29 17:02:53,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 9c44e17cded9f1fd84080059a7e32843, server=jenkins-hbase4.apache.org,44759,1696006873606 in 173 msec 2023-09-29 17:02:53,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-29 17:02:53,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 987f37cb50410d9f1a54a84207b04a85, server=jenkins-hbase4.apache.org,45619,1696006873557 in 173 msec 2023-09-29 17:02:53,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c44e17cded9f1fd84080059a7e32843, ASSIGN in 333 msec 2023-09-29 17:02:53,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-29 17:02:53,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=987f37cb50410d9f1a54a84207b04a85, ASSIGN in 334 msec 2023-09-29 17:02:53,745 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 17:02:53,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006973745"}]},"ts":"1696006973745"} 2023-09-29 17:02:53,746 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-29 17:02:53,748 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 17:02:53,748 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-29 17:02:53,750 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-29 17:02:53,751 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,751 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,751 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,751 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:02:53,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:53,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:53,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:53,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 17:02:53,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 403 msec 2023-09-29 17:02:53,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 17:02:53,959 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-29 17:02:53,961 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:53,961 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:53,963 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:02:53,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 17:02:53,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006973973 (current time:1696006973973). 2023-09-29 17:02:53,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:02:53,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x6644e360 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:53,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4874e45b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:53,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:53,983 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:53,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6644e360 to 127.0.0.1:64917 2023-09-29 17:02:53,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:53,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x332d1e0b to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:53,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10587457, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:53,992 DEBUG [hconnection-0x5b1fcab0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:53,995 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:53,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x332d1e0b to 127.0.0.1:64917 2023-09-29 17:02:54,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:54,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-29 17:02:54,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:02:54,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 17:02:54,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 17:02:54,004 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 17:02:54,004 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696007574004 2023-09-29 17:02:54,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 17:02:54,004 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,006 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:02:54,006 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:02:54,007 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 17:02:54,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 17:02:54,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-29 17:02:54,009 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 17:02:54,010 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696007574009 2023-09-29 17:02:54,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,019 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-29 17:02:54,019 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,021 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-29 17:02:54,021 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-29 17:02:54,021 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,021 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,024 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,024 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,024 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,024 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,024 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,024 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,025 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,025 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,026 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,026 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 17:02:54,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,026 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 17:02:54,026 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 17:02:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 17:02:54,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 17:02:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 17:02:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 17:02:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 17:02:54,034 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 17:02:54,035 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 17:02:54,034 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 17:02:54,035 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 17:02:54,042 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,042 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,042 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,042 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,042 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,042 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,043 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:54,043 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,043 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,043 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:54,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,043 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2658eca0[Count = 1] remaining members to acquire global barrier 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 17:02:54,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2658eca0[Count = 0] remaining members to acquire global barrier 2023-09-29 17:02:54,047 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-29 17:02:54,047 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 17:02:54,048 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 17:02:54,048 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 17:02:54,048 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,048 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:02:54,048 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 17:02:54,048 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:54,049 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:54,048 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:54,049 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,049 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:54,049 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:54,049 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:54,049 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. started... 2023-09-29 17:02:54,049 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:02:54,049 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. started... 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 987f37cb50410d9f1a54a84207b04a85: 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c44e17cded9f1fd84080059a7e32843: 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:02:54,051 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 17:02:54,051 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 17:02:54,051 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,051 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 17:02:54,063 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. completed. 2023-09-29 17:02:54,063 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:54,063 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:54,063 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:54,063 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,063 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 17:02:54,063 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:02:54,063 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. completed. 2023-09-29 17:02:54,064 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:54,064 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:54,064 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:54,064 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,064 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 17:02:54,064 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:02:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 17:02:54,065 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 17:02:54,067 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,067 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 17:02:54,068 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,068 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 17:02:54,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-29 17:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:02:54,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-29 17:02:54,076 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-29 17:02:54,076 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:02:54,076 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:02:54,076 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,076 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:02:54,078 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,078 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,079 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,080 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,080 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,081 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,082 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,082 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,087 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,085 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,085 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,085 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,088 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,087 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,089 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,089 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,089 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:02:54,089 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,089 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,089 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 17:02:54,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,106 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:54,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 17:02:54,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:02:54,108 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:02:54,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-29 17:02:54,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,114 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696006974005Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696006974098 (+93 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696006974098Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696006974098Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696006974101 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696006974109 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696006974114 (+5 ms) 2023-09-29 17:02:54,117 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 17:02:54,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 111 msec 2023-09-29 17:02:54,308 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 17:02:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:02:54,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44759] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:02:54,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45619] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 17:02:54,314 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,314 DEBUG [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:54,314 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 17:02:54,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 17:02:54,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696006974323 (current time:1696006974323). 2023-09-29 17:02:54,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 17:02:54,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x2ca48314 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:54,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9cb867a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:54,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:54,335 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:54,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ca48314 to 127.0.0.1:64917 2023-09-29 17:02:54,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:54,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(139): Connect 0x66dc0e72 to 127.0.0.1:64917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 17:02:54,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e688d9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 17:02:54,348 DEBUG [hconnection-0x3bc53e7f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 17:02:54,349 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 17:02:54,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66dc0e72 to 127.0.0.1:64917 2023-09-29 17:02:54,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:02:54,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-29 17:02:54,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 17:02:54,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 17:02:54,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 17:02:54,359 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 17:02:54,360 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696007574360 2023-09-29 17:02:54,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 17:02:54,362 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 17:02:54,362 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 17:02:54,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 17:02:54,363 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 17:02:54,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-29 17:02:54,365 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 17:02:54,366 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696007574366 2023-09-29 17:02:54,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,377 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-29 17:02:54,377 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,378 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-29 17:02:54,378 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-29 17:02:54,379 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,379 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,381 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,381 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,381 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,381 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,381 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,381 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,382 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-29 17:02:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 17:02:54,383 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,384 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 17:02:54,384 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 17:02:54,384 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 17:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,384 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 17:02:54,384 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 17:02:54,385 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 17:02:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 17:02:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 17:02:54,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 17:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 17:02:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 17:02:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 17:02:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44811,1696006873656' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 17:02:54,387 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,388 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,388 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,388 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,388 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 17:02:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45619,1696006873557' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 17:02:54,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57b280e2[Count = 1] remaining members to acquire global barrier 2023-09-29 17:02:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44759,1696006873606' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 17:02:54,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57b280e2[Count = 0] remaining members to acquire global barrier 2023-09-29 17:02:54,394 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-29 17:02:54,394 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,398 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,398 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,398 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,398 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 17:02:54,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,398 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 17:02:54,399 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44811,1696006873656' in zk 2023-09-29 17:02:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 17:02:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 17:02:54,399 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,399 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 17:02:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:54,399 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 17:02:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 17:02:54,399 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:54,399 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. started... 2023-09-29 17:02:54,399 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. started... 2023-09-29 17:02:54,399 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c44e17cded9f1fd84080059a7e32843 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-29 17:02:54,399 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 987f37cb50410d9f1a54a84207b04a85 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-29 17:02:54,400 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 17:02:54,400 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,400 DEBUG [member: 'jenkins-hbase4.apache.org,44811,1696006873656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 17:02:54,429 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309299e1af87bb1b34dc4972c8fd41408f923 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309299e1af87bb1b34dc4972c8fd41408f923 2023-09-29 17:02:54,441 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309297c11f602198644908e01d87393fc5db0 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309297c11f602198644908e01d87393fc5db0 2023-09-29 17:02:54,445 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/.tmp/cf/e85e2388086542c1827d469deef896d3 2023-09-29 17:02:54,450 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/.tmp/cf/e85e2388086542c1827d469deef896d3 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf/e85e2388086542c1827d469deef896d3 2023-09-29 17:02:54,455 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf/e85e2388086542c1827d469deef896d3, entries=44, sequenceid=6, filesize=12.8 K 2023-09-29 17:02:54,456 INFO [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 987f37cb50410d9f1a54a84207b04a85 in 57ms, sequenceid=6, compaction requested=false 2023-09-29 17:02:54,456 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-29 17:02:54,457 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 987f37cb50410d9f1a54a84207b04a85: 2023-09-29 17:02:54,457 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,457 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:54,457 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf/e85e2388086542c1827d469deef896d3] hfiles 2023-09-29 17:02:54,457 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf/e85e2388086542c1827d469deef896d3 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,459 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/.tmp/cf/28261175b4d74c9cbb330438c0e28d81 2023-09-29 17:02:54,462 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:54,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 17:02:54,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-29 17:02:54,463 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 17:02:54,464 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/.tmp/cf/28261175b4d74c9cbb330438c0e28d81 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf/28261175b4d74c9cbb330438c0e28d81 2023-09-29 17:02:54,468 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf/28261175b4d74c9cbb330438c0e28d81, entries=6, sequenceid=6, filesize=6.0 K 2023-09-29 17:02:54,469 INFO [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 9c44e17cded9f1fd84080059a7e32843 in 70ms, sequenceid=6, compaction requested=false 2023-09-29 17:02:54,471 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c44e17cded9f1fd84080059a7e32843: 2023-09-29 17:02:54,472 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,472 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 17:02:54,472 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf/28261175b4d74c9cbb330438c0e28d81] hfiles 2023-09-29 17:02:54,472 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf/28261175b4d74c9cbb330438c0e28d81 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,476 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. completed. 2023-09-29 17:02:54,476 DEBUG [rs(jenkins-hbase4.apache.org,45619,1696006873557)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:02:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,477 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 17:02:54,477 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45619,1696006873557' in zk 2023-09-29 17:02:54,479 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,479 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 17:02:54,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,479 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,479 DEBUG [member: 'jenkins-hbase4.apache.org,45619,1696006873557' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 17:02:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45619,1696006873557': 2023-09-29 17:02:54,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45619,1696006873557' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-29 17:02:54,488 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. completed. 2023-09-29 17:02:54,488 DEBUG [rs(jenkins-hbase4.apache.org,44759,1696006873606)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:02:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 17:02:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 17:02:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 17:02:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44759,1696006873606' in zk 2023-09-29 17:02:54,490 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 17:02:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,44759,1696006873606' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 17:02:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44759,1696006873606': 2023-09-29 17:02:54,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44759,1696006873606' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-29 17:02:54,495 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-29 17:02:54,496 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 17:02:54,496 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 17:02:54,496 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,496 INFO [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 17:02:54,497 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,497 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,497 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,497 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 17:02:54,498 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,498 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,498 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 17:02:54,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,499 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,500 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 17:02:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 17:02:54,501 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,502 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,502 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 17:02:54,505 DEBUG [(jenkins-hbase4.apache.org,45867,1696006872285)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 17:02:54,505 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 17:02:54,506 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:02:54,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,508 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 17:02:54,508 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:02:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,508 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:02:54,508 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 17:02:54,508 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309299e1af87bb1b34dc4972c8fd41408f923, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309297c11f602198644908e01d87393fc5db0] mob files 2023-09-29 17:02:54,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309299e1af87bb1b34dc4972c8fd41408f923 2023-09-29 17:02:54,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 17:02:54,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 17:02:54,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309297c11f602198644908e01d87393fc5db0 2023-09-29 17:02:54,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-29 17:02:54,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,540 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696006974360Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696006974516 (+156 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696006974516Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696006974516Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696006974520 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696006974531 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696006974538 (+7 ms) 2023-09-29 17:02:54,542 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 17:02:54,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 182 msec 2023-09-29 17:02:54,664 DEBUG [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 17:02:54,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 17:02:54,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 17:02:54,665 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665 2023-09-29 17:02:54,665 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39529, tgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665, rawTgtDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665, srcFsUri=hdfs://localhost:39529, srcDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:54,688 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd 2023-09-29 17:02:54,688 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1829902434_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,688 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39529, inputRoot=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd, snapshotDir=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-29 17:02:54,697 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:02:54,714 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:54,715 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:54,715 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:54,715 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,591 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-6429338401202829834.jar 2023-09-29 17:02:55,591 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,592 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,658 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/hadoop-7111440525676701542.jar 2023-09-29 17:02:55,659 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,659 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,659 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,660 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,660 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,660 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 17:02:55,661 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 17:02:55,661 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 17:02:55,661 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 17:02:55,662 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 17:02:55,662 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 17:02:55,663 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 17:02:55,663 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 17:02:55,663 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 17:02:55,663 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 17:02:55,664 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 17:02:55,665 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:55,665 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:55,665 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:55,666 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:55,666 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 17:02:55,666 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:55,667 DEBUG [Listener at jenkins-hbase4.apache.org/46659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 17:02:56,423 WARN [Listener at jenkins-hbase4.apache.org/46659] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 17:02:56,425 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-29 17:02:56,427 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-29 17:02:57,507 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:57,507 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 17:02:57,510 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0006_000001 (auth:SIMPLE) 2023-09-29 17:02:57,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0007_000001 (auth:SIMPLE) 2023-09-29 17:02:58,637 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:03:01,895 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0007_000001 (auth:SIMPLE) 2023-09-29 17:03:04,109 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0007_000001 (auth:SIMPLE) 2023-09-29 17:03:06,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696006880214_0007_000001 (auth:SIMPLE) 2023-09-29 17:03:08,592 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 17:03:08,592 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 17:03:08,603 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,603 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 17:03:08,604 INFO [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 17:03:08,604 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,604 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-29 17:03:08,604 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-29 17:03:08,605 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-975241179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,605 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-29 17:03:08,605 DEBUG [Listener at jenkins-hbase4.apache.org/46659] snapshot.TestExportSnapshot(367): hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/export-test/export-1696006974665/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-29 17:03:08,611 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-29 17:03:08,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006988615"}]},"ts":"1696006988615"} 2023-09-29 17:03:08,616 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-29 17:03:08,618 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-29 17:03:08,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c44e17cded9f1fd84080059a7e32843, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=987f37cb50410d9f1a54a84207b04a85, UNASSIGN}] 2023-09-29 17:03:08,620 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c44e17cded9f1fd84080059a7e32843, UNASSIGN 2023-09-29 17:03:08,620 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=987f37cb50410d9f1a54a84207b04a85, UNASSIGN 2023-09-29 17:03:08,621 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9c44e17cded9f1fd84080059a7e32843, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:03:08,621 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=987f37cb50410d9f1a54a84207b04a85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:03:08,621 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006988621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006988621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006988621"}]},"ts":"1696006988621"} 2023-09-29 17:03:08,621 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006988621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696006988621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696006988621"}]},"ts":"1696006988621"} 2023-09-29 17:03:08,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 9c44e17cded9f1fd84080059a7e32843, server=jenkins-hbase4.apache.org,44759,1696006873606}] 2023-09-29 17:03:08,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 987f37cb50410d9f1a54a84207b04a85, server=jenkins-hbase4.apache.org,45619,1696006873557}] 2023-09-29 17:03:08,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-29 17:03:08,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:03:08,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c44e17cded9f1fd84080059a7e32843, disabling compactions & flushes 2023-09-29 17:03:08,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:03:08,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:03:08,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. after waiting 0 ms 2023-09-29 17:03:08,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:03:08,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:03:08,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 987f37cb50410d9f1a54a84207b04a85, disabling compactions & flushes 2023-09-29 17:03:08,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:03:08,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:03:08,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. after waiting 0 ms 2023-09-29 17:03:08,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:03:08,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:03:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:03:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:08,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843. 2023-09-29 17:03:08,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c44e17cded9f1fd84080059a7e32843: 2023-09-29 17:03:08,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:08,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85. 2023-09-29 17:03:08,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 987f37cb50410d9f1a54a84207b04a85: 2023-09-29 17:03:08,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:03:08,790 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9c44e17cded9f1fd84080059a7e32843, regionState=CLOSED 2023-09-29 17:03:08,790 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006988790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006988790"}]},"ts":"1696006988790"} 2023-09-29 17:03:08,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:03:08,791 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=987f37cb50410d9f1a54a84207b04a85, regionState=CLOSED 2023-09-29 17:03:08,791 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696006988791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696006988791"}]},"ts":"1696006988791"} 2023-09-29 17:03:08,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-29 17:03:08,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 9c44e17cded9f1fd84080059a7e32843, server=jenkins-hbase4.apache.org,44759,1696006873606 in 169 msec 2023-09-29 17:03:08,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-29 17:03:08,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 987f37cb50410d9f1a54a84207b04a85, server=jenkins-hbase4.apache.org,45619,1696006873557 in 169 msec 2023-09-29 17:03:08,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c44e17cded9f1fd84080059a7e32843, UNASSIGN in 175 msec 2023-09-29 17:03:08,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-29 17:03:08,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=987f37cb50410d9f1a54a84207b04a85, UNASSIGN in 176 msec 2023-09-29 17:03:08,796 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696006988796"}]},"ts":"1696006988796"} 2023-09-29 17:03:08,797 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-29 17:03:08,799 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-29 17:03:08,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-09-29 17:03:08,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-29 17:03:08,917 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-29 17:03:08,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,921 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,921 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,923 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44759] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,925 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:03:08,925 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:03:08,926 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,926 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,926 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,926 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-29 17:03:08,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/recovered.edits] 2023-09-29 17:03:08,927 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf, FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/recovered.edits] 2023-09-29 17:03:08,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-29 17:03:08,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-29 17:03:08,929 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,929 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,929 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:03:08,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-29 17:03:08,929 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,929 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:03:08,929 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:03:08,929 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 17:03:08,929 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 17:03:08,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-29 17:03:08,932 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf/28261175b4d74c9cbb330438c0e28d81 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/cf/28261175b4d74c9cbb330438c0e28d81 2023-09-29 17:03:08,932 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf/e85e2388086542c1827d469deef896d3 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/cf/e85e2388086542c1827d469deef896d3 2023-09-29 17:03:08,936 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843/recovered.edits/9.seqid 2023-09-29 17:03:08,936 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/recovered.edits/9.seqid to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85/recovered.edits/9.seqid 2023-09-29 17:03:08,937 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c44e17cded9f1fd84080059a7e32843 2023-09-29 17:03:08,937 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/987f37cb50410d9f1a54a84207b04a85 2023-09-29 17:03:08,937 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-29 17:03:08,937 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-29 17:03:08,938 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-29 17:03:08,942 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309299e1af87bb1b34dc4972c8fd41408f923 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309299e1af87bb1b34dc4972c8fd41408f923 2023-09-29 17:03:08,943 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309297c11f602198644908e01d87393fc5db0 to hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309297c11f602198644908e01d87393fc5db0 2023-09-29 17:03:08,944 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-29 17:03:08,946 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,948 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-29 17:03:08,950 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-29 17:03:08,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-29 17:03:08,952 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006988952"}]},"ts":"9223372036854775807"} 2023-09-29 17:03:08,952 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696006988952"}]},"ts":"9223372036854775807"} 2023-09-29 17:03:08,953 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 17:03:08,953 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c44e17cded9f1fd84080059a7e32843, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696006973350.9c44e17cded9f1fd84080059a7e32843.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 987f37cb50410d9f1a54a84207b04a85, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696006973350.987f37cb50410d9f1a54a84207b04a85.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 17:03:08,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-29 17:03:08,954 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696006988954"}]},"ts":"9223372036854775807"} 2023-09-29 17:03:08,955 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-29 17:03:08,957 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:08,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 39 msec 2023-09-29 17:03:09,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-29 17:03:09,032 INFO [Listener at jenkins-hbase4.apache.org/46659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-29 17:03:09,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-29 17:03:09,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:09,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-29 17:03:09,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45867] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 17:03:09,068 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 765), OpenFileDescriptor=901 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 282), ProcessCount=167 (was 167), AvailableMemoryMB=1006 (was 818) - AvailableMemoryMB LEAK? - 2023-09-29 17:03:09,068 WARN [Listener at jenkins-hbase4.apache.org/46659] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-29 17:03:09,068 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-29 17:03:09,079 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 17:03:09,189 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696006880214_0007_01_000001 is : 143 2023-09-29 17:03:14,356 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 17:03:23,201 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 17:03:37,314 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-29 17:03:37,315 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 17:03:37,422 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-29 17:03:37,428 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-29 17:03:37,429 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-29 17:03:37,440 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 17:03:37,543 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-29 17:03:37,543 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-29 17:03:37,543 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-29 17:03:37,543 INFO [Listener at jenkins-hbase4.apache.org/46659] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-29 17:03:37,543 DEBUG [Listener at jenkins-hbase4.apache.org/46659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:64917 2023-09-29 17:03:37,544 DEBUG [Listener at jenkins-hbase4.apache.org/46659] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:37,544 DEBUG [Listener at jenkins-hbase4.apache.org/46659] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-29 17:03:37,544 DEBUG [Listener at jenkins-hbase4.apache.org/46659] util.JVMClusterUtil(257): Found active master hash=875714014, stopped=false 2023-09-29 17:03:37,544 DEBUG [Listener at jenkins-hbase4.apache.org/46659] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:37,544 DEBUG [Listener at jenkins-hbase4.apache.org/46659] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-29 17:03:37,544 INFO [Listener at jenkins-hbase4.apache.org/46659] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:03:37,546 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 17:03:37,546 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 17:03:37,546 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 17:03:37,546 INFO [Listener at jenkins-hbase4.apache.org/46659] procedure2.ProcedureExecutor(628): Stopping 2023-09-29 17:03:37,546 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 17:03:37,546 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 17:03:37,546 DEBUG [Listener at jenkins-hbase4.apache.org/46659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17258fa1 to 127.0.0.1:64917 2023-09-29 17:03:37,546 DEBUG [Listener at jenkins-hbase4.apache.org/46659] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:37,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:03:37,546 INFO [Listener at jenkins-hbase4.apache.org/46659] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45619,1696006873557' ***** 2023-09-29 17:03:37,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:03:37,547 DEBUG [Listener at jenkins-hbase4.apache.org/46659] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:37,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:03:37,547 INFO [Listener at jenkins-hbase4.apache.org/46659] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-29 17:03:37,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 17:03:37,547 INFO [Listener at jenkins-hbase4.apache.org/46659] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44759,1696006873606' ***** 2023-09-29 17:03:37,547 DEBUG [Listener at jenkins-hbase4.apache.org/46659] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:37,547 INFO [RS:0;jenkins-hbase4:45619] regionserver.HeapMemoryManager(220): Stopping 2023-09-29 17:03:37,547 INFO [Listener at jenkins-hbase4.apache.org/46659] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-29 17:03:37,547 INFO [Listener at jenkins-hbase4.apache.org/46659] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44811,1696006873656' ***** 2023-09-29 17:03:37,547 INFO [RS:0;jenkins-hbase4:45619] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-29 17:03:37,547 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-29 17:03:37,547 DEBUG [Listener at jenkins-hbase4.apache.org/46659] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:37,547 INFO [RS:1;jenkins-hbase4:44759] regionserver.HeapMemoryManager(220): Stopping 2023-09-29 17:03:37,548 INFO [Listener at jenkins-hbase4.apache.org/46659] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-29 17:03:37,548 INFO [RS:0;jenkins-hbase4:45619] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-29 17:03:37,548 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-29 17:03:37,548 INFO [RS:2;jenkins-hbase4:44811] regionserver.HeapMemoryManager(220): Stopping 2023-09-29 17:03:37,548 INFO [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:03:37,548 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-29 17:03:37,548 DEBUG [RS:0;jenkins-hbase4:45619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a4851c6 to 127.0.0.1:64917 2023-09-29 17:03:37,548 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-29 17:03:37,548 INFO [RS:1;jenkins-hbase4:44759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-29 17:03:37,548 DEBUG [RS:0;jenkins-hbase4:45619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:37,548 INFO [RS:2;jenkins-hbase4:44811] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-29 17:03:37,548 INFO [RS:1;jenkins-hbase4:44759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-29 17:03:37,550 INFO [RS:2;jenkins-hbase4:44811] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-29 17:03:37,550 INFO [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45619,1696006873557; all regions closed. 2023-09-29 17:03:37,550 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(3305): Received CLOSE for 6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:03:37,550 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(3305): Received CLOSE for ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:03:37,550 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:03:37,550 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:03:37,550 DEBUG [RS:1;jenkins-hbase4:44759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bca26ef to 127.0.0.1:64917 2023-09-29 17:03:37,550 DEBUG [RS:2;jenkins-hbase4:44811] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x511f2592 to 127.0.0.1:64917 2023-09-29 17:03:37,550 DEBUG [RS:1;jenkins-hbase4:44759] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:37,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ffce55fc122492b057ac52d6fcecdfab, disabling compactions & flushes 2023-09-29 17:03:37,553 INFO [RS:1;jenkins-hbase4:44759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-29 17:03:37,553 INFO [RS:1;jenkins-hbase4:44759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-29 17:03:37,553 INFO [RS:1;jenkins-hbase4:44759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-29 17:03:37,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:03:37,553 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-29 17:03:37,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:03:37,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6deb34af46634b50fb84a49c53039ea5, disabling compactions & flushes 2023-09-29 17:03:37,550 DEBUG [RS:2;jenkins-hbase4:44811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:37,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:03:37,553 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-29 17:03:37,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. after waiting 0 ms 2023-09-29 17:03:37,554 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, ffce55fc122492b057ac52d6fcecdfab=hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab.} 2023-09-29 17:03:37,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:03:37,554 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-29 17:03:37,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:03:37,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ffce55fc122492b057ac52d6fcecdfab 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-29 17:03:37,554 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1478): Online Regions={6deb34af46634b50fb84a49c53039ea5=hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5.} 2023-09-29 17:03:37,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-29 17:03:37,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. after waiting 0 ms 2023-09-29 17:03:37,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-29 17:03:37,555 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-29 17:03:37,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:03:37,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6deb34af46634b50fb84a49c53039ea5 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-29 17:03:37,555 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-29 17:03:37,555 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-29 17:03:37,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-29 17:03:37,555 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1504): Waiting on 1588230740, ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:03:37,555 DEBUG [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1504): Waiting on 6deb34af46634b50fb84a49c53039ea5 2023-09-29 17:03:37,570 DEBUG [RS:0;jenkins-hbase4:45619] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs 2023-09-29 17:03:37,570 INFO [RS:0;jenkins-hbase4:45619] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45619%2C1696006873557:(num 1696006875324) 2023-09-29 17:03:37,570 DEBUG [RS:0;jenkins-hbase4:45619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:37,570 INFO [RS:0;jenkins-hbase4:45619] regionserver.LeaseManager(133): Closed leases 2023-09-29 17:03:37,571 INFO [RS:0;jenkins-hbase4:45619] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-29 17:03:37,573 INFO [RS:0;jenkins-hbase4:45619] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-29 17:03:37,573 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 17:03:37,573 INFO [RS:0;jenkins-hbase4:45619] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-29 17:03:37,573 INFO [RS:0;jenkins-hbase4:45619] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-29 17:03:37,574 INFO [RS:0;jenkins-hbase4:45619] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45619 2023-09-29 17:03:37,580 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:03:37,580 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:03:37,580 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 17:03:37,580 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45619,1696006873557 2023-09-29 17:03:37,580 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 17:03:37,580 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 17:03:37,580 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 17:03:37,582 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45619,1696006873557] 2023-09-29 17:03:37,583 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45619,1696006873557; numProcessing=1 2023-09-29 17:03:37,585 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45619,1696006873557 already deleted, retry=false 2023-09-29 17:03:37,585 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45619,1696006873557 expired; onlineServers=2 2023-09-29 17:03:37,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/.tmp/info/4c4c3e7c30594ce3b7d555ffad9dea38 2023-09-29 17:03:37,586 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/.tmp/info/80356b9b6d3f4c298ff3079e5be7481e 2023-09-29 17:03:37,594 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80356b9b6d3f4c298ff3079e5be7481e 2023-09-29 17:03:37,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/.tmp/info/4c4c3e7c30594ce3b7d555ffad9dea38 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/info/4c4c3e7c30594ce3b7d555ffad9dea38 2023-09-29 17:03:37,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/info/4c4c3e7c30594ce3b7d555ffad9dea38, entries=2, sequenceid=6, filesize=4.8 K 2023-09-29 17:03:37,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6deb34af46634b50fb84a49c53039ea5 in 46ms, sequenceid=6, compaction requested=false 2023-09-29 17:03:37,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/.tmp/rep_barrier/8da647dd8a78414e887742c582235df4 2023-09-29 17:03:37,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/namespace/6deb34af46634b50fb84a49c53039ea5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 17:03:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:37,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:03:37,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6deb34af46634b50fb84a49c53039ea5: 2023-09-29 17:03:37,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696006875841.6deb34af46634b50fb84a49c53039ea5. 2023-09-29 17:03:37,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8da647dd8a78414e887742c582235df4 2023-09-29 17:03:37,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/.tmp/table/2b41c68f06414b25a24919da6b7e8498 2023-09-29 17:03:37,630 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b41c68f06414b25a24919da6b7e8498 2023-09-29 17:03:37,631 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/.tmp/info/80356b9b6d3f4c298ff3079e5be7481e as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/info/80356b9b6d3f4c298ff3079e5be7481e 2023-09-29 17:03:37,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80356b9b6d3f4c298ff3079e5be7481e 2023-09-29 17:03:37,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/info/80356b9b6d3f4c298ff3079e5be7481e, entries=48, sequenceid=131, filesize=10.3 K 2023-09-29 17:03:37,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/.tmp/rep_barrier/8da647dd8a78414e887742c582235df4 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/rep_barrier/8da647dd8a78414e887742c582235df4 2023-09-29 17:03:37,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8da647dd8a78414e887742c582235df4 2023-09-29 17:03:37,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/rep_barrier/8da647dd8a78414e887742c582235df4, entries=13, sequenceid=131, filesize=6.4 K 2023-09-29 17:03:37,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/.tmp/table/2b41c68f06414b25a24919da6b7e8498 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/table/2b41c68f06414b25a24919da6b7e8498 2023-09-29 17:03:37,643 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-29 17:03:37,643 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-29 17:03:37,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b41c68f06414b25a24919da6b7e8498 2023-09-29 17:03:37,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/table/2b41c68f06414b25a24919da6b7e8498, entries=24, sequenceid=131, filesize=6.9 K 2023-09-29 17:03:37,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 92ms, sequenceid=131, compaction requested=false 2023-09-29 17:03:37,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-29 17:03:37,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:37,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-29 17:03:37,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-29 17:03:37,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-29 17:03:37,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-29 17:03:37,683 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:37,683 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:45619-0x100f8a250cc0001, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:37,683 INFO [RS:0;jenkins-hbase4:45619] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45619,1696006873557; zookeeper connection closed. 2023-09-29 17:03:37,684 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@165168cb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@165168cb 2023-09-29 17:03:37,755 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44811,1696006873656; all regions closed. 2023-09-29 17:03:37,756 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1504): Waiting on ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:03:37,762 DEBUG [RS:2;jenkins-hbase4:44811] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs 2023-09-29 17:03:37,762 INFO [RS:2;jenkins-hbase4:44811] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44811%2C1696006873656:(num 1696006875325) 2023-09-29 17:03:37,762 DEBUG [RS:2;jenkins-hbase4:44811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:37,762 INFO [RS:2;jenkins-hbase4:44811] regionserver.LeaseManager(133): Closed leases 2023-09-29 17:03:37,762 INFO [RS:2;jenkins-hbase4:44811] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-29 17:03:37,763 INFO [RS:2;jenkins-hbase4:44811] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-29 17:03:37,763 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 17:03:37,763 INFO [RS:2;jenkins-hbase4:44811] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-29 17:03:37,763 INFO [RS:2;jenkins-hbase4:44811] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-29 17:03:37,764 INFO [RS:2;jenkins-hbase4:44811] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44811 2023-09-29 17:03:37,766 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:03:37,766 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44811,1696006873656 2023-09-29 17:03:37,766 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 17:03:37,767 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44811,1696006873656] 2023-09-29 17:03:37,767 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44811,1696006873656; numProcessing=2 2023-09-29 17:03:37,768 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44811,1696006873656 already deleted, retry=false 2023-09-29 17:03:37,768 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44811,1696006873656 expired; onlineServers=1 2023-09-29 17:03:37,867 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:37,867 INFO [RS:2;jenkins-hbase4:44811] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44811,1696006873656; zookeeper connection closed. 2023-09-29 17:03:37,867 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44811-0x100f8a250cc0003, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:37,868 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e1b057a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e1b057a 2023-09-29 17:03:37,956 DEBUG [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1504): Waiting on ffce55fc122492b057ac52d6fcecdfab 2023-09-29 17:03:37,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/.tmp/l/6a62a486d56143fbbe2d66cc84136336 2023-09-29 17:03:37,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a62a486d56143fbbe2d66cc84136336 2023-09-29 17:03:37,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/.tmp/l/6a62a486d56143fbbe2d66cc84136336 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/l/6a62a486d56143fbbe2d66cc84136336 2023-09-29 17:03:37,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a62a486d56143fbbe2d66cc84136336 2023-09-29 17:03:37,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/l/6a62a486d56143fbbe2d66cc84136336, entries=7, sequenceid=18, filesize=5.2 K 2023-09-29 17:03:37,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ffce55fc122492b057ac52d6fcecdfab in 442ms, sequenceid=18, compaction requested=false 2023-09-29 17:03:38,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/data/hbase/acl/ffce55fc122492b057ac52d6fcecdfab/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-29 17:03:38,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 17:03:38,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:03:38,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ffce55fc122492b057ac52d6fcecdfab: 2023-09-29 17:03:38,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696006876590.ffce55fc122492b057ac52d6fcecdfab. 2023-09-29 17:03:38,155 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-29 17:03:38,156 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-29 17:03:38,156 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44759,1696006873606; all regions closed. 2023-09-29 17:03:38,162 DEBUG [RS:1;jenkins-hbase4:44759] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs 2023-09-29 17:03:38,162 INFO [RS:1;jenkins-hbase4:44759] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44759%2C1696006873606.meta:.meta(num 1696006875542) 2023-09-29 17:03:38,167 DEBUG [RS:1;jenkins-hbase4:44759] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/oldWALs 2023-09-29 17:03:38,167 INFO [RS:1;jenkins-hbase4:44759] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44759%2C1696006873606:(num 1696006875325) 2023-09-29 17:03:38,167 DEBUG [RS:1;jenkins-hbase4:44759] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:38,167 INFO [RS:1;jenkins-hbase4:44759] regionserver.LeaseManager(133): Closed leases 2023-09-29 17:03:38,167 INFO [RS:1;jenkins-hbase4:44759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-29 17:03:38,167 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 17:03:38,168 INFO [RS:1;jenkins-hbase4:44759] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44759 2023-09-29 17:03:38,171 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44759,1696006873606 2023-09-29 17:03:38,171 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 17:03:38,172 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44759,1696006873606] 2023-09-29 17:03:38,172 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44759,1696006873606; numProcessing=3 2023-09-29 17:03:38,173 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44759,1696006873606 already deleted, retry=false 2023-09-29 17:03:38,173 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44759,1696006873606 expired; onlineServers=0 2023-09-29 17:03:38,173 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45867,1696006872285' ***** 2023-09-29 17:03:38,173 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-29 17:03:38,174 DEBUG [M:0;jenkins-hbase4:45867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@750f5fe5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 17:03:38,174 INFO [M:0;jenkins-hbase4:45867] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45867,1696006872285 2023-09-29 17:03:38,174 INFO [M:0;jenkins-hbase4:45867] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45867,1696006872285; all regions closed. 2023-09-29 17:03:38,174 DEBUG [M:0;jenkins-hbase4:45867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 17:03:38,174 DEBUG [M:0;jenkins-hbase4:45867] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-29 17:03:38,174 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-29 17:03:38,174 DEBUG [M:0;jenkins-hbase4:45867] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-29 17:03:38,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696006874969] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696006874969,5,FailOnTimeoutGroup] 2023-09-29 17:03:38,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696006874967] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696006874967,5,FailOnTimeoutGroup] 2023-09-29 17:03:38,174 INFO [M:0;jenkins-hbase4:45867] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-29 17:03:38,174 INFO [M:0;jenkins-hbase4:45867] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-29 17:03:38,174 INFO [M:0;jenkins-hbase4:45867] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-29 17:03:38,175 DEBUG [M:0;jenkins-hbase4:45867] master.HMaster(1512): Stopping service threads 2023-09-29 17:03:38,175 INFO [M:0;jenkins-hbase4:45867] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-29 17:03:38,175 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-29 17:03:38,175 ERROR [M:0;jenkins-hbase4:45867] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-09-29 17:03:38,175 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-29 17:03:38,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 17:03:38,176 INFO [M:0;jenkins-hbase4:45867] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-29 17:03:38,176 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-29 17:03:38,176 DEBUG [M:0;jenkins-hbase4:45867] zookeeper.ZKUtil(398): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-29 17:03:38,176 WARN [M:0;jenkins-hbase4:45867] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-29 17:03:38,176 INFO [M:0;jenkins-hbase4:45867] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-29 17:03:38,176 INFO [M:0;jenkins-hbase4:45867] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-29 17:03:38,177 DEBUG [M:0;jenkins-hbase4:45867] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-29 17:03:38,177 INFO [M:0;jenkins-hbase4:45867] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:03:38,177 DEBUG [M:0;jenkins-hbase4:45867] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:03:38,177 DEBUG [M:0;jenkins-hbase4:45867] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-29 17:03:38,177 DEBUG [M:0;jenkins-hbase4:45867] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:03:38,177 INFO [M:0;jenkins-hbase4:45867] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.87 KB heapSize=452.12 KB 2023-09-29 17:03:38,196 INFO [M:0;jenkins-hbase4:45867] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.87 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/604f4b51ebe04d8491e61e1430bedff9 2023-09-29 17:03:38,200 INFO [M:0;jenkins-hbase4:45867] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 604f4b51ebe04d8491e61e1430bedff9 2023-09-29 17:03:38,201 DEBUG [M:0;jenkins-hbase4:45867] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/604f4b51ebe04d8491e61e1430bedff9 as hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/604f4b51ebe04d8491e61e1430bedff9 2023-09-29 17:03:38,205 INFO [M:0;jenkins-hbase4:45867] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 604f4b51ebe04d8491e61e1430bedff9 2023-09-29 17:03:38,205 INFO [M:0;jenkins-hbase4:45867] regionserver.HStore(1080): Added hdfs://localhost:39529/user/jenkins/test-data/996c8131-e625-b16f-92d7-5fd7e1b9ffbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/604f4b51ebe04d8491e61e1430bedff9, entries=119, sequenceid=899, filesize=28.7 K 2023-09-29 17:03:38,206 INFO [M:0;jenkins-hbase4:45867] regionserver.HRegion(2948): Finished flush of dataSize ~375.87 KB/384889, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-09-29 17:03:38,208 INFO [M:0;jenkins-hbase4:45867] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 17:03:38,208 DEBUG [M:0;jenkins-hbase4:45867] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-29 17:03:38,211 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 17:03:38,211 INFO [M:0;jenkins-hbase4:45867] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-29 17:03:38,212 INFO [M:0;jenkins-hbase4:45867] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45867 2023-09-29 17:03:38,214 DEBUG [M:0;jenkins-hbase4:45867] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45867,1696006872285 already deleted, retry=false 2023-09-29 17:03:38,273 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:38,273 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): regionserver:44759-0x100f8a250cc0002, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:38,273 INFO [RS:1;jenkins-hbase4:44759] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44759,1696006873606; zookeeper connection closed. 2023-09-29 17:03:38,273 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f95edf3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f95edf3 2023-09-29 17:03:38,273 INFO [Listener at jenkins-hbase4.apache.org/46659] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-29 17:03:38,373 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:38,373 DEBUG [Listener at localhost/35437-EventThread] zookeeper.ZKWatcher(600): master:45867-0x100f8a250cc0000, quorum=127.0.0.1:64917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 17:03:38,373 INFO [M:0;jenkins-hbase4:45867] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45867,1696006872285; zookeeper connection closed. 2023-09-29 17:03:38,375 WARN [Listener at jenkins-hbase4.apache.org/46659] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-29 17:03:38,378 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 17:03:38,482 WARN [BP-772536509-172.31.14.131-1696006868491 heartbeating to localhost/127.0.0.1:39529] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-29 17:03:38,482 WARN [BP-772536509-172.31.14.131-1696006868491 heartbeating to localhost/127.0.0.1:39529] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-772536509-172.31.14.131-1696006868491 (Datanode Uuid 387289f8-5563-46a1-a712-5c985f7939e6) service to localhost/127.0.0.1:39529 2023-09-29 17:03:38,484 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data5/current/BP-772536509-172.31.14.131-1696006868491] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 17:03:38,484 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data6/current/BP-772536509-172.31.14.131-1696006868491] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 17:03:38,485 WARN [Listener at jenkins-hbase4.apache.org/46659] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-29 17:03:38,487 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 17:03:38,591 WARN [BP-772536509-172.31.14.131-1696006868491 heartbeating to localhost/127.0.0.1:39529] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-29 17:03:38,591 WARN [BP-772536509-172.31.14.131-1696006868491 heartbeating to localhost/127.0.0.1:39529] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-772536509-172.31.14.131-1696006868491 (Datanode Uuid 96ec9e29-e704-4387-9076-2ae44666f02d) service to localhost/127.0.0.1:39529 2023-09-29 17:03:38,591 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data3/current/BP-772536509-172.31.14.131-1696006868491] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 17:03:38,592 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data4/current/BP-772536509-172.31.14.131-1696006868491] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 17:03:38,593 WARN [Listener at jenkins-hbase4.apache.org/46659] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-29 17:03:38,595 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 17:03:38,698 WARN [BP-772536509-172.31.14.131-1696006868491 heartbeating to localhost/127.0.0.1:39529] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-29 17:03:38,698 WARN [BP-772536509-172.31.14.131-1696006868491 heartbeating to localhost/127.0.0.1:39529] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-772536509-172.31.14.131-1696006868491 (Datanode Uuid a702c466-2269-4b88-ae0c-f77d1de5bb7b) service to localhost/127.0.0.1:39529 2023-09-29 17:03:38,699 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data1/current/BP-772536509-172.31.14.131-1696006868491] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 17:03:38,699 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb593240-be49-35ff-7035-152fc0e6a2bd/cluster_0a30fb1c-f403-de3f-70f0-e9e4e07c03ad/dfs/data/data2/current/BP-772536509-172.31.14.131-1696006868491] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 17:03:38,720 INFO [Listener at jenkins-hbase4.apache.org/46659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 17:03:38,846 INFO [Listener at jenkins-hbase4.apache.org/46659] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-29 17:03:38,935 INFO [Listener at jenkins-hbase4.apache.org/46659] hbase.HBaseTestingUtility(1293): Minicluster is down