2023-09-16 16:01:05,376 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-16 16:01:05,599 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31 2023-09-16 16:01:05,599 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-16 16:01:05,600 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-16 16:01:05,640 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-16 16:01:05,913 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-16 16:01:05,914 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230, deleteOnExit=true 2023-09-16 16:01:05,914 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-16 16:01:05,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/test.cache.data in system properties and HBase conf 2023-09-16 16:01:05,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop.tmp.dir in system properties and HBase conf 2023-09-16 16:01:05,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop.log.dir in system properties and HBase conf 2023-09-16 16:01:05,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-16 16:01:05,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-16 16:01:05,917 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-16 16:01:06,236 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-16 16:01:06,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-16 16:01:06,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-16 16:01:06,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-16 16:01:06,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-16 16:01:06,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-16 16:01:06,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-16 16:01:06,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-16 16:01:06,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-16 16:01:06,243 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-16 16:01:06,243 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/nfs.dump.dir in system properties and HBase conf 2023-09-16 16:01:06,243 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir in system properties and HBase conf 2023-09-16 16:01:06,243 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-16 16:01:06,244 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-16 16:01:06,244 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-16 16:01:06,757 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-16 16:01:06,762 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-16 16:01:07,066 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-16 16:01:07,234 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-16 16:01:07,247 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:07,288 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:07,326 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_localhost_42391_hdfs____.sfwjyh/webapp 2023-09-16 16:01:07,487 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42391 2023-09-16 16:01:07,498 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-16 16:01:07,498 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-16 16:01:08,034 WARN [Listener at localhost/42433] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-16 16:01:08,108 WARN [Listener at localhost/42433] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-16 16:01:08,130 WARN [Listener at localhost/42433] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:08,188 INFO [Listener at localhost/42433] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:08,194 INFO [Listener at localhost/42433] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_localhost_39761_datanode____y9wq9f/webapp 2023-09-16 16:01:08,292 INFO [Listener at localhost/42433] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39761 2023-09-16 16:01:08,690 WARN [Listener at localhost/39357] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-16 16:01:08,704 WARN [Listener at localhost/39357] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-16 16:01:08,709 WARN [Listener at localhost/39357] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:08,711 INFO [Listener at localhost/39357] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:08,721 INFO [Listener at localhost/39357] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_localhost_35497_datanode____a335w7/webapp 2023-09-16 16:01:08,824 INFO [Listener at localhost/39357] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35497 2023-09-16 16:01:08,834 WARN [Listener at localhost/41695] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-16 16:01:08,854 WARN [Listener at localhost/41695] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-16 16:01:08,858 WARN [Listener at localhost/41695] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:08,860 INFO [Listener at localhost/41695] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:08,869 INFO [Listener at localhost/41695] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_localhost_40991_datanode____fd5x8c/webapp 2023-09-16 16:01:09,012 INFO [Listener at localhost/41695] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40991 2023-09-16 16:01:09,041 WARN [Listener at localhost/36395] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-16 16:01:09,415 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfdb6695da8e280ba: Processing first storage report for DS-fe31818a-f998-43cb-ac37-6d1f6567016c from datanode 5351cc32-90ab-47fc-953c-caa254796032 2023-09-16 16:01:09,417 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfdb6695da8e280ba: from storage DS-fe31818a-f998-43cb-ac37-6d1f6567016c node DatanodeRegistration(127.0.0.1:38409, datanodeUuid=5351cc32-90ab-47fc-953c-caa254796032, infoPort=33585, infoSecurePort=0, ipcPort=41695, storageInfo=lv=-57;cid=testClusterID;nsid=58162356;c=1694880066845), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-16 16:01:09,417 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf15883f22fdfa1d5: Processing first storage report for DS-545aac30-8254-4692-9171-edf38279282b from datanode 1a5c4b32-c07b-4178-b74f-e2f3202b06d1 2023-09-16 16:01:09,417 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf15883f22fdfa1d5: from storage DS-545aac30-8254-4692-9171-edf38279282b node DatanodeRegistration(127.0.0.1:46245, datanodeUuid=1a5c4b32-c07b-4178-b74f-e2f3202b06d1, infoPort=43511, infoSecurePort=0, ipcPort=39357, storageInfo=lv=-57;cid=testClusterID;nsid=58162356;c=1694880066845), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-16 16:01:09,418 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24627204247b6902: Processing first storage report for DS-60cbbd92-7944-492f-8c67-e98dfaf37e31 from datanode b83353fc-5ccd-4bcd-ab27-6ba958804917 2023-09-16 16:01:09,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24627204247b6902: from storage DS-60cbbd92-7944-492f-8c67-e98dfaf37e31 node DatanodeRegistration(127.0.0.1:46083, datanodeUuid=b83353fc-5ccd-4bcd-ab27-6ba958804917, infoPort=39425, infoSecurePort=0, ipcPort=36395, storageInfo=lv=-57;cid=testClusterID;nsid=58162356;c=1694880066845), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-16 16:01:09,418 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfdb6695da8e280ba: Processing first storage report for DS-ffd4efd8-87c3-4a85-b5f2-2ef5ee5a7bdd from datanode 5351cc32-90ab-47fc-953c-caa254796032 2023-09-16 16:01:09,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfdb6695da8e280ba: from storage DS-ffd4efd8-87c3-4a85-b5f2-2ef5ee5a7bdd node DatanodeRegistration(127.0.0.1:38409, datanodeUuid=5351cc32-90ab-47fc-953c-caa254796032, infoPort=33585, infoSecurePort=0, ipcPort=41695, storageInfo=lv=-57;cid=testClusterID;nsid=58162356;c=1694880066845), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-16 16:01:09,418 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf15883f22fdfa1d5: Processing first storage report for DS-43f9fea3-153d-4345-bbab-f4e8cedb9665 from datanode 1a5c4b32-c07b-4178-b74f-e2f3202b06d1 2023-09-16 16:01:09,419 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf15883f22fdfa1d5: from storage DS-43f9fea3-153d-4345-bbab-f4e8cedb9665 node DatanodeRegistration(127.0.0.1:46245, datanodeUuid=1a5c4b32-c07b-4178-b74f-e2f3202b06d1, infoPort=43511, infoSecurePort=0, ipcPort=39357, storageInfo=lv=-57;cid=testClusterID;nsid=58162356;c=1694880066845), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-16 16:01:09,419 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24627204247b6902: Processing first storage report for DS-ba43f08e-1d5e-43b3-97af-3aa3ac7e1b45 from datanode b83353fc-5ccd-4bcd-ab27-6ba958804917 2023-09-16 16:01:09,419 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24627204247b6902: from storage DS-ba43f08e-1d5e-43b3-97af-3aa3ac7e1b45 node DatanodeRegistration(127.0.0.1:46083, datanodeUuid=b83353fc-5ccd-4bcd-ab27-6ba958804917, infoPort=39425, infoSecurePort=0, ipcPort=36395, storageInfo=lv=-57;cid=testClusterID;nsid=58162356;c=1694880066845), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-16 16:01:09,582 DEBUG [Listener at localhost/36395] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31 2023-09-16 16:01:09,688 INFO [Listener at localhost/36395] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/zookeeper_0, clientPort=61309, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-16 16:01:09,713 INFO [Listener at localhost/36395] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61309 2023-09-16 16:01:09,721 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:09,723 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:10,424 INFO [Listener at localhost/36395] util.FSUtils(471): Created version file at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 with version=8 2023-09-16 16:01:10,425 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/hbase-staging 2023-09-16 16:01:10,878 INFO [Listener at localhost/36395] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-16 16:01:11,372 INFO [Listener at localhost/36395] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-16 16:01:11,404 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,405 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,405 INFO [Listener at localhost/36395] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-16 16:01:11,405 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,405 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-16 16:01:11,545 INFO [Listener at localhost/36395] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-16 16:01:11,617 DEBUG [Listener at localhost/36395] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-16 16:01:11,708 INFO [Listener at localhost/36395] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42795 2023-09-16 16:01:11,721 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:11,723 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:11,746 INFO [Listener at localhost/36395] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42795 connecting to ZooKeeper ensemble=127.0.0.1:61309 2023-09-16 16:01:11,805 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:427950x0, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-16 16:01:11,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42795-0x100b578afc80000 connected 2023-09-16 16:01:11,840 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-16 16:01:11,841 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:01:11,853 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-16 16:01:11,861 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42795 2023-09-16 16:01:11,861 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42795 2023-09-16 16:01:11,862 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42795 2023-09-16 16:01:11,865 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42795 2023-09-16 16:01:11,865 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42795 2023-09-16 16:01:11,871 INFO [Listener at localhost/36395] master.HMaster(444): hbase.rootdir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, hbase.cluster.distributed=false 2023-09-16 16:01:11,932 INFO [Listener at localhost/36395] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-16 16:01:11,933 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,933 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,933 INFO [Listener at localhost/36395] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-16 16:01:11,933 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,933 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-16 16:01:11,938 INFO [Listener at localhost/36395] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-16 16:01:11,941 INFO [Listener at localhost/36395] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35809 2023-09-16 16:01:11,943 INFO [Listener at localhost/36395] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-16 16:01:11,950 INFO [Listener at localhost/36395] mob.MobFileCache(124): MobFileCache disabled 2023-09-16 16:01:11,951 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:11,953 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:11,956 INFO [Listener at localhost/36395] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35809 connecting to ZooKeeper ensemble=127.0.0.1:61309 2023-09-16 16:01:11,961 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:358090x0, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-16 16:01:11,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35809-0x100b578afc80001 connected 2023-09-16 16:01:11,962 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-16 16:01:11,963 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:01:11,964 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-16 16:01:11,965 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35809 2023-09-16 16:01:11,969 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35809 2023-09-16 16:01:11,969 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35809 2023-09-16 16:01:11,970 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35809 2023-09-16 16:01:11,970 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35809 2023-09-16 16:01:11,982 INFO [Listener at localhost/36395] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-16 16:01:11,982 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,982 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,983 INFO [Listener at localhost/36395] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-16 16:01:11,983 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:11,983 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-16 16:01:11,983 INFO [Listener at localhost/36395] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-16 16:01:11,985 INFO [Listener at localhost/36395] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45159 2023-09-16 16:01:11,985 INFO [Listener at localhost/36395] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-16 16:01:11,989 INFO [Listener at localhost/36395] mob.MobFileCache(124): MobFileCache disabled 2023-09-16 16:01:11,989 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:11,992 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:11,995 INFO [Listener at localhost/36395] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45159 connecting to ZooKeeper ensemble=127.0.0.1:61309 2023-09-16 16:01:11,999 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:451590x0, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-16 16:01:12,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45159-0x100b578afc80002 connected 2023-09-16 16:01:12,000 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-16 16:01:12,001 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:01:12,002 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-16 16:01:12,003 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45159 2023-09-16 16:01:12,004 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45159 2023-09-16 16:01:12,004 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45159 2023-09-16 16:01:12,005 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45159 2023-09-16 16:01:12,009 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45159 2023-09-16 16:01:12,021 INFO [Listener at localhost/36395] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-16 16:01:12,021 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:12,021 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:12,021 INFO [Listener at localhost/36395] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-16 16:01:12,021 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-16 16:01:12,021 INFO [Listener at localhost/36395] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-16 16:01:12,021 INFO [Listener at localhost/36395] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-16 16:01:12,023 INFO [Listener at localhost/36395] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42403 2023-09-16 16:01:12,023 INFO [Listener at localhost/36395] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-16 16:01:12,024 INFO [Listener at localhost/36395] mob.MobFileCache(124): MobFileCache disabled 2023-09-16 16:01:12,025 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:12,026 INFO [Listener at localhost/36395] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:12,028 INFO [Listener at localhost/36395] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42403 connecting to ZooKeeper ensemble=127.0.0.1:61309 2023-09-16 16:01:12,031 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:424030x0, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-16 16:01:12,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42403-0x100b578afc80003 connected 2023-09-16 16:01:12,032 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-16 16:01:12,033 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:01:12,034 DEBUG [Listener at localhost/36395] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-16 16:01:12,037 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42403 2023-09-16 16:01:12,037 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42403 2023-09-16 16:01:12,038 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42403 2023-09-16 16:01:12,038 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42403 2023-09-16 16:01:12,041 DEBUG [Listener at localhost/36395] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42403 2023-09-16 16:01:12,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:12,053 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-16 16:01:12,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:12,077 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-16 16:01:12,077 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-16 16:01:12,077 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:12,077 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-16 16:01:12,077 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-16 16:01:12,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-16 16:01:12,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-16 16:01:12,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42795,1694880070696 from backup master directory 2023-09-16 16:01:12,085 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:12,085 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-16 16:01:12,086 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-16 16:01:12,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:12,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-16 16:01:12,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-16 16:01:12,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/hbase.id with ID: 6c333289-00d5-4c14-ae42-3fce01aa5ec4 2023-09-16 16:01:12,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-16 16:01:12,259 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:12,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x07256ea5 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:12,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@226a4ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:12,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-16 16:01:12,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-16 16:01:12,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-16 16:01:12,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-16 16:01:12,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-16 16:01:12,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-16 16:01:12,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-16 16:01:12,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store-tmp 2023-09-16 16:01:12,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:12,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-16 16:01:12,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:01:12,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:01:12,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-16 16:01:12,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:01:12,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:01:12,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-16 16:01:12,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/WALs/jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:12,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42795%2C1694880070696, suffix=, logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/WALs/jenkins-hbase4.apache.org,42795,1694880070696, archiveDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/oldWALs, maxLogs=10 2023-09-16 16:01:12,569 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK] 2023-09-16 16:01:12,569 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK] 2023-09-16 16:01:12,569 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK] 2023-09-16 16:01:12,579 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-16 16:01:12,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/WALs/jenkins-hbase4.apache.org,42795,1694880070696/jenkins-hbase4.apache.org%2C42795%2C1694880070696.1694880072519 2023-09-16 16:01:12,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK], DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK], DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK]] 2023-09-16 16:01:12,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-16 16:01:12,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:12,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-16 16:01:12,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-16 16:01:12,734 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-16 16:01:12,740 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-16 16:01:12,769 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-16 16:01:12,781 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:12,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-16 16:01:12,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-16 16:01:12,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-16 16:01:12,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:12,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62449384, jitterRate=-0.06943166255950928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:12,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-16 16:01:12,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-16 16:01:12,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-16 16:01:12,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-16 16:01:12,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-16 16:01:12,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-16 16:01:12,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-16 16:01:12,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-16 16:01:12,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-16 16:01:12,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-16 16:01:12,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-16 16:01:12,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-16 16:01:12,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-16 16:01:12,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-16 16:01:12,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-16 16:01:12,958 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:12,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-16 16:01:12,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-16 16:01:12,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-16 16:01:12,983 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-16 16:01:12,983 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-16 16:01:12,983 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:12,983 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-16 16:01:12,983 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-16 16:01:12,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42795,1694880070696, sessionid=0x100b578afc80000, setting cluster-up flag (Was=false) 2023-09-16 16:01:13,006 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:13,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-16 16:01:13,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:13,020 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:13,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-16 16:01:13,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:13,030 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp 2023-09-16 16:01:13,046 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(951): ClusterId : 6c333289-00d5-4c14-ae42-3fce01aa5ec4 2023-09-16 16:01:13,046 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(951): ClusterId : 6c333289-00d5-4c14-ae42-3fce01aa5ec4 2023-09-16 16:01:13,048 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(951): ClusterId : 6c333289-00d5-4c14-ae42-3fce01aa5ec4 2023-09-16 16:01:13,053 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-16 16:01:13,053 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-16 16:01:13,053 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-16 16:01:13,062 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-16 16:01:13,062 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-16 16:01:13,062 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-16 16:01:13,063 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-16 16:01:13,063 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-16 16:01:13,063 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-16 16:01:13,067 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-16 16:01:13,067 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-16 16:01:13,068 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-16 16:01:13,076 DEBUG [RS:1;jenkins-hbase4:45159] zookeeper.ReadOnlyZKClient(139): Connect 0x0fc3f1db to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:13,076 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ReadOnlyZKClient(139): Connect 0x4a1ea2c4 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:13,086 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ReadOnlyZKClient(139): Connect 0x2c3c37d8 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:13,092 DEBUG [RS:1;jenkins-hbase4:45159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1041e53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:13,093 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44d945f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:13,093 DEBUG [RS:1;jenkins-hbase4:45159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53b9aab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-16 16:01:13,093 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40e6c9b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-16 16:01:13,129 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22fbdc2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:13,129 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26c45ca8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-16 16:01:13,159 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45159 2023-09-16 16:01:13,161 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35809 2023-09-16 16:01:13,162 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42403 2023-09-16 16:01:13,164 INFO [RS:1;jenkins-hbase4:45159] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-16 16:01:13,164 INFO [RS:2;jenkins-hbase4:42403] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-16 16:01:13,166 INFO [RS:2;jenkins-hbase4:42403] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-16 16:01:13,164 INFO [RS:0;jenkins-hbase4:35809] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-16 16:01:13,166 INFO [RS:1;jenkins-hbase4:45159] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-16 16:01:13,167 INFO [RS:0;jenkins-hbase4:35809] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-16 16:01:13,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-16 16:01:13,177 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-16 16:01:13,177 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-16 16:01:13,177 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-16 16:01:13,180 INFO [RS:0;jenkins-hbase4:35809] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:13,180 INFO [RS:2;jenkins-hbase4:42403] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:13,180 INFO [RS:1;jenkins-hbase4:45159] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:13,180 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1022): About to register with Master. 2023-09-16 16:01:13,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:13,180 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1022): About to register with Master. 2023-09-16 16:01:13,180 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1022): About to register with Master. 2023-09-16 16:01:13,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-16 16:01:13,183 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1694880070696 with isa=jenkins-hbase4.apache.org/172.31.14.131:45159, startcode=1694880071982 2023-09-16 16:01:13,183 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1694880070696 with isa=jenkins-hbase4.apache.org/172.31.14.131:42403, startcode=1694880072020 2023-09-16 16:01:13,183 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1694880070696 with isa=jenkins-hbase4.apache.org/172.31.14.131:35809, startcode=1694880071932 2023-09-16 16:01:13,202 DEBUG [RS:1;jenkins-hbase4:45159] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-16 16:01:13,202 DEBUG [RS:0;jenkins-hbase4:35809] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-16 16:01:13,202 DEBUG [RS:2;jenkins-hbase4:42403] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-16 16:01:13,265 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58433, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-16 16:01:13,265 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44223, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-16 16:01:13,265 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33927, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-16 16:01:13,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-16 16:01:13,273 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-16 16:01:13,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694880103279 2023-09-16 16:01:13,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-16 16:01:13,284 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-16 16:01:13,284 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-16 16:01:13,288 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-16 16:01:13,289 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-16 16:01:13,294 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-16 16:01:13,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-16 16:01:13,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-16 16:01:13,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-16 16:01:13,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-16 16:01:13,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-16 16:01:13,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,307 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(2830): Master is not running yet 2023-09-16 16:01:13,307 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(2830): Master is not running yet 2023-09-16 16:01:13,307 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(2830): Master is not running yet 2023-09-16 16:01:13,308 WARN [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-16 16:01:13,308 WARN [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-16 16:01:13,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-16 16:01:13,308 WARN [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-16 16:01:13,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-16 16:01:13,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-16 16:01:13,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-16 16:01:13,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-16 16:01:13,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694880073315,5,FailOnTimeoutGroup] 2023-09-16 16:01:13,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694880073315,5,FailOnTimeoutGroup] 2023-09-16 16:01:13,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-16 16:01:13,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,338 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-16 16:01:13,339 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-16 16:01:13,340 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:13,361 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:13,364 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-16 16:01:13,366 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/info 2023-09-16 16:01:13,367 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-16 16:01:13,368 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:13,368 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-16 16:01:13,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/rep_barrier 2023-09-16 16:01:13,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-16 16:01:13,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:13,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-16 16:01:13,375 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/table 2023-09-16 16:01:13,375 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-16 16:01:13,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:13,377 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740 2023-09-16 16:01:13,378 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740 2023-09-16 16:01:13,382 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-16 16:01:13,385 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-16 16:01:13,388 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:13,389 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62222757, jitterRate=-0.07280866801738739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-16 16:01:13,389 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-16 16:01:13,389 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-16 16:01:13,389 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-16 16:01:13,389 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-16 16:01:13,389 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-16 16:01:13,389 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-16 16:01:13,391 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-16 16:01:13,391 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-16 16:01:13,397 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-16 16:01:13,397 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-16 16:01:13,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-16 16:01:13,409 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1694880070696 with isa=jenkins-hbase4.apache.org/172.31.14.131:45159, startcode=1694880071982 2023-09-16 16:01:13,409 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1694880070696 with isa=jenkins-hbase4.apache.org/172.31.14.131:35809, startcode=1694880071932 2023-09-16 16:01:13,409 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1694880070696 with isa=jenkins-hbase4.apache.org/172.31.14.131:42403, startcode=1694880072020 2023-09-16 16:01:13,415 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,420 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-16 16:01:13,422 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,423 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,424 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:13,424 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42433 2023-09-16 16:01:13,424 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-16 16:01:13,428 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:13,428 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42433 2023-09-16 16:01:13,428 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-16 16:01:13,429 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:13,429 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42433 2023-09-16 16:01:13,429 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-16 16:01:13,429 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-16 16:01:13,430 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-16 16:01:13,438 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,438 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,438 WARN [RS:2;jenkins-hbase4:42403] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-16 16:01:13,438 WARN [RS:0;jenkins-hbase4:35809] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-16 16:01:13,438 INFO [RS:2;jenkins-hbase4:42403] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-16 16:01:13,439 INFO [RS:0;jenkins-hbase4:35809] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-16 16:01:13,439 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45159,1694880071982] 2023-09-16 16:01:13,439 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,439 DEBUG [RS:1;jenkins-hbase4:45159] zookeeper.ZKUtil(162): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,439 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35809,1694880071932] 2023-09-16 16:01:13,439 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42403,1694880072020] 2023-09-16 16:01:13,439 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,439 WARN [RS:1;jenkins-hbase4:45159] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-16 16:01:13,440 INFO [RS:1;jenkins-hbase4:45159] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-16 16:01:13,440 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,455 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,455 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,455 DEBUG [RS:1;jenkins-hbase4:45159] zookeeper.ZKUtil(162): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,455 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,455 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,456 DEBUG [RS:1;jenkins-hbase4:45159] zookeeper.ZKUtil(162): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,456 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,456 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,456 DEBUG [RS:1;jenkins-hbase4:45159] zookeeper.ZKUtil(162): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,467 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-16 16:01:13,467 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-16 16:01:13,467 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-16 16:01:13,477 INFO [RS:0;jenkins-hbase4:35809] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-16 16:01:13,477 INFO [RS:1;jenkins-hbase4:45159] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-16 16:01:13,477 INFO [RS:2;jenkins-hbase4:42403] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-16 16:01:13,503 INFO [RS:0;jenkins-hbase4:35809] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-16 16:01:13,503 INFO [RS:1;jenkins-hbase4:45159] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-16 16:01:13,503 INFO [RS:2;jenkins-hbase4:42403] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-16 16:01:13,508 INFO [RS:1;jenkins-hbase4:45159] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-16 16:01:13,508 INFO [RS:2;jenkins-hbase4:42403] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-16 16:01:13,508 INFO [RS:0;jenkins-hbase4:35809] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-16 16:01:13,509 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,509 INFO [RS:1;jenkins-hbase4:45159] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,509 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,511 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-16 16:01:13,511 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-16 16:01:13,511 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-16 16:01:13,518 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,518 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,518 INFO [RS:1;jenkins-hbase4:45159] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,519 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,519 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,519 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,519 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,519 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,519 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:1;jenkins-hbase4:45159] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,520 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,521 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,522 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-16 16:01:13,522 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,522 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,522 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,522 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-16 16:01:13,524 INFO [RS:1;jenkins-hbase4:45159] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,524 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,525 INFO [RS:1;jenkins-hbase4:45159] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,525 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,525 INFO [RS:1;jenkins-hbase4:45159] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,525 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,529 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,529 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,529 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,547 INFO [RS:2;jenkins-hbase4:42403] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-16 16:01:13,547 INFO [RS:0;jenkins-hbase4:35809] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-16 16:01:13,547 INFO [RS:1;jenkins-hbase4:45159] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-16 16:01:13,551 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42403,1694880072020-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,551 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35809,1694880071932-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,551 INFO [RS:1;jenkins-hbase4:45159] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45159,1694880071982-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:13,573 INFO [RS:1;jenkins-hbase4:45159] regionserver.Replication(203): jenkins-hbase4.apache.org,45159,1694880071982 started 2023-09-16 16:01:13,573 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45159,1694880071982, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45159, sessionid=0x100b578afc80002 2023-09-16 16:01:13,573 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-16 16:01:13,573 DEBUG [RS:1;jenkins-hbase4:45159] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,573 DEBUG [RS:1;jenkins-hbase4:45159] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45159,1694880071982' 2023-09-16 16:01:13,573 DEBUG [RS:1;jenkins-hbase4:45159] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-16 16:01:13,574 INFO [RS:2;jenkins-hbase4:42403] regionserver.Replication(203): jenkins-hbase4.apache.org,42403,1694880072020 started 2023-09-16 16:01:13,574 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42403,1694880072020, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42403, sessionid=0x100b578afc80003 2023-09-16 16:01:13,574 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-16 16:01:13,574 DEBUG [RS:2;jenkins-hbase4:42403] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,575 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42403,1694880072020' 2023-09-16 16:01:13,576 DEBUG [RS:1;jenkins-hbase4:45159] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-16 16:01:13,576 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-16 16:01:13,577 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-16 16:01:13,577 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-16 16:01:13,577 INFO [RS:0;jenkins-hbase4:35809] regionserver.Replication(203): jenkins-hbase4.apache.org,35809,1694880071932 started 2023-09-16 16:01:13,577 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-16 16:01:13,578 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35809,1694880071932, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35809, sessionid=0x100b578afc80001 2023-09-16 16:01:13,578 DEBUG [RS:1;jenkins-hbase4:45159] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,578 DEBUG [RS:1;jenkins-hbase4:45159] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45159,1694880071982' 2023-09-16 16:01:13,578 DEBUG [RS:1;jenkins-hbase4:45159] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:13,578 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-16 16:01:13,578 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-16 16:01:13,578 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-16 16:01:13,578 DEBUG [RS:2;jenkins-hbase4:42403] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:13,578 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42403,1694880072020' 2023-09-16 16:01:13,578 DEBUG [RS:0;jenkins-hbase4:35809] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,579 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:13,579 DEBUG [RS:1;jenkins-hbase4:45159] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:13,579 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35809,1694880071932' 2023-09-16 16:01:13,579 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-16 16:01:13,579 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:13,580 DEBUG [RS:1;jenkins-hbase4:45159] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-16 16:01:13,580 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-16 16:01:13,580 INFO [RS:1;jenkins-hbase4:45159] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-16 16:01:13,580 INFO [RS:1;jenkins-hbase4:45159] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-16 16:01:13,582 DEBUG [jenkins-hbase4:42795] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-16 16:01:13,585 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-16 16:01:13,585 INFO [RS:2;jenkins-hbase4:42403] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-16 16:01:13,585 INFO [RS:2;jenkins-hbase4:42403] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-16 16:01:13,585 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-16 16:01:13,585 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-16 16:01:13,585 DEBUG [RS:0;jenkins-hbase4:35809] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:13,585 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35809,1694880071932' 2023-09-16 16:01:13,585 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:13,586 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:13,586 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-16 16:01:13,586 INFO [RS:0;jenkins-hbase4:35809] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-16 16:01:13,586 INFO [RS:0;jenkins-hbase4:35809] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-16 16:01:13,586 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:01:13,592 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:01:13,593 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:01:13,593 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:01:13,593 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:01:13,596 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45159,1694880071982, state=OPENING 2023-09-16 16:01:13,603 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-16 16:01:13,605 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:13,605 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-16 16:01:13,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:01:13,691 INFO [RS:1;jenkins-hbase4:45159] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45159%2C1694880071982, suffix=, logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,45159,1694880071982, archiveDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs, maxLogs=32 2023-09-16 16:01:13,691 INFO [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42403%2C1694880072020, suffix=, logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,42403,1694880072020, archiveDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs, maxLogs=32 2023-09-16 16:01:13,691 INFO [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35809%2C1694880071932, suffix=, logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,35809,1694880071932, archiveDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs, maxLogs=32 2023-09-16 16:01:13,722 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK] 2023-09-16 16:01:13,722 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK] 2023-09-16 16:01:13,723 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK] 2023-09-16 16:01:13,723 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK] 2023-09-16 16:01:13,724 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK] 2023-09-16 16:01:13,725 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK] 2023-09-16 16:01:13,725 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK] 2023-09-16 16:01:13,725 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK] 2023-09-16 16:01:13,726 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK] 2023-09-16 16:01:13,740 INFO [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,35809,1694880071932/jenkins-hbase4.apache.org%2C35809%2C1694880071932.1694880073696 2023-09-16 16:01:13,740 INFO [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,42403,1694880072020/jenkins-hbase4.apache.org%2C42403%2C1694880072020.1694880073696 2023-09-16 16:01:13,740 INFO [RS:1;jenkins-hbase4:45159] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,45159,1694880071982/jenkins-hbase4.apache.org%2C45159%2C1694880071982.1694880073696 2023-09-16 16:01:13,740 DEBUG [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK], DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK], DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK]] 2023-09-16 16:01:13,740 DEBUG [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK], DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK], DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK]] 2023-09-16 16:01:13,741 DEBUG [RS:1;jenkins-hbase4:45159] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK], DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK], DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK]] 2023-09-16 16:01:13,794 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:13,796 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-16 16:01:13,800 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-16 16:01:13,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-16 16:01:13,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-16 16:01:13,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45159%2C1694880071982.meta, suffix=.meta, logDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,45159,1694880071982, archiveDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs, maxLogs=32 2023-09-16 16:01:13,839 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK] 2023-09-16 16:01:13,840 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK] 2023-09-16 16:01:13,841 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK] 2023-09-16 16:01:13,850 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/WALs/jenkins-hbase4.apache.org,45159,1694880071982/jenkins-hbase4.apache.org%2C45159%2C1694880071982.meta.1694880073820.meta 2023-09-16 16:01:13,851 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-60cbbd92-7944-492f-8c67-e98dfaf37e31,DISK], DatanodeInfoWithStorage[127.0.0.1:46245,DS-545aac30-8254-4692-9171-edf38279282b,DISK], DatanodeInfoWithStorage[127.0.0.1:38409,DS-fe31818a-f998-43cb-ac37-6d1f6567016c,DISK]] 2023-09-16 16:01:13,851 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-16 16:01:13,852 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-16 16:01:13,854 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:13,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-16 16:01:13,856 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-16 16:01:13,858 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-16 16:01:13,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-16 16:01:13,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:13,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-16 16:01:13,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-16 16:01:13,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-16 16:01:13,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/info 2023-09-16 16:01:13,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/info 2023-09-16 16:01:13,883 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-16 16:01:13,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:13,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-16 16:01:13,886 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/rep_barrier 2023-09-16 16:01:13,886 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/rep_barrier 2023-09-16 16:01:13,886 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-16 16:01:13,887 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:13,887 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-16 16:01:13,889 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/table 2023-09-16 16:01:13,889 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/table 2023-09-16 16:01:13,890 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-16 16:01:13,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:13,897 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740 2023-09-16 16:01:13,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740 2023-09-16 16:01:13,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-16 16:01:13,907 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-16 16:01:13,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67411775, jitterRate=0.004513725638389587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-16 16:01:13,911 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-16 16:01:13,920 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694880073786 2023-09-16 16:01:13,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-16 16:01:13,940 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-16 16:01:13,941 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45159,1694880071982, state=OPEN 2023-09-16 16:01:13,945 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-16 16:01:13,945 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-16 16:01:13,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-16 16:01:13,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45159,1694880071982 in 336 msec 2023-09-16 16:01:13,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-16 16:01:13,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 546 msec 2023-09-16 16:01:13,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 772 msec 2023-09-16 16:01:13,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694880073969, completionTime=-1 2023-09-16 16:01:13,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-16 16:01:13,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-16 16:01:14,041 DEBUG [hconnection-0x6d1938d5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:14,044 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:14,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-16 16:01:14,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694880134066 2023-09-16 16:01:14,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694880194066 2023-09-16 16:01:14,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-09-16 16:01:14,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1694880070696-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:14,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1694880070696-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:14,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1694880070696-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:14,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42795, period=300000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:14,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-16 16:01:14,106 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-16 16:01:14,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-16 16:01:14,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-16 16:01:14,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-16 16:01:14,132 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:01:14,136 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:01:14,159 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,162 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7 empty. 2023-09-16 16:01:14,163 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,163 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-16 16:01:14,204 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-16 16:01:14,207 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 338a3d38233b332ab5ce8699d85141e7, NAME => 'hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:14,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:14,226 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 338a3d38233b332ab5ce8699d85141e7, disabling compactions & flushes 2023-09-16 16:01:14,226 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:01:14,226 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:01:14,226 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. after waiting 0 ms 2023-09-16 16:01:14,226 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:01:14,226 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:01:14,226 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 338a3d38233b332ab5ce8699d85141e7: 2023-09-16 16:01:14,231 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:01:14,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694880074234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880074234"}]},"ts":"1694880074234"} 2023-09-16 16:01:14,283 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-16 16:01:14,285 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:01:14,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880074285"}]},"ts":"1694880074285"} 2023-09-16 16:01:14,293 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-16 16:01:14,299 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:01:14,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:01:14,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:01:14,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:01:14,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:01:14,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=338a3d38233b332ab5ce8699d85141e7, ASSIGN}] 2023-09-16 16:01:14,306 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=338a3d38233b332ab5ce8699d85141e7, ASSIGN 2023-09-16 16:01:14,308 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=338a3d38233b332ab5ce8699d85141e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1694880072020; forceNewPlan=false, retain=false 2023-09-16 16:01:14,460 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-16 16:01:14,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=338a3d38233b332ab5ce8699d85141e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:14,462 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694880074461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880074461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880074461"}]},"ts":"1694880074461"} 2023-09-16 16:01:14,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 338a3d38233b332ab5ce8699d85141e7, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:01:14,623 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:14,623 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-16 16:01:14,626 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-16 16:01:14,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:01:14,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 338a3d38233b332ab5ce8699d85141e7, NAME => 'hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.', STARTKEY => '', ENDKEY => ''} 2023-09-16 16:01:14,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. service=AccessControlService 2023-09-16 16:01:14,634 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:14,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:14,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,637 INFO [StoreOpener-338a3d38233b332ab5ce8699d85141e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,639 DEBUG [StoreOpener-338a3d38233b332ab5ce8699d85141e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/info 2023-09-16 16:01:14,639 DEBUG [StoreOpener-338a3d38233b332ab5ce8699d85141e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/info 2023-09-16 16:01:14,639 INFO [StoreOpener-338a3d38233b332ab5ce8699d85141e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 338a3d38233b332ab5ce8699d85141e7 columnFamilyName info 2023-09-16 16:01:14,640 INFO [StoreOpener-338a3d38233b332ab5ce8699d85141e7-1] regionserver.HStore(310): Store=338a3d38233b332ab5ce8699d85141e7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:14,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:01:14,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:14,651 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 338a3d38233b332ab5ce8699d85141e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68903071, jitterRate=0.026735767722129822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:14,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 338a3d38233b332ab5ce8699d85141e7: 2023-09-16 16:01:14,654 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7., pid=6, masterSystemTime=1694880074623 2023-09-16 16:01:14,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:01:14,658 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:01:14,660 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=338a3d38233b332ab5ce8699d85141e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:14,660 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694880074659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880074659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880074659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880074659"}]},"ts":"1694880074659"} 2023-09-16 16:01:14,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-16 16:01:14,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 338a3d38233b332ab5ce8699d85141e7, server=jenkins-hbase4.apache.org,42403,1694880072020 in 195 msec 2023-09-16 16:01:14,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-16 16:01:14,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=338a3d38233b332ab5ce8699d85141e7, ASSIGN in 365 msec 2023-09-16 16:01:14,674 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:01:14,674 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880074674"}]},"ts":"1694880074674"} 2023-09-16 16:01:14,676 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-16 16:01:14,679 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:01:14,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 560 msec 2023-09-16 16:01:14,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-16 16:01:14,733 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-16 16:01:14,733 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:14,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:14,757 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:14,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-16 16:01:14,786 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-16 16:01:14,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-09-16 16:01:14,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-16 16:01:14,815 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-16 16:01:14,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-16 16:01:14,830 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-16 16:01:14,832 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-16 16:01:14,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.747sec 2023-09-16 16:01:14,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-16 16:01:14,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-16 16:01:14,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-16 16:01:14,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1694880070696-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-16 16:01:14,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1694880070696-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-16 16:01:14,853 DEBUG [Listener at localhost/36395] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:14,859 DEBUG [Listener at localhost/36395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:14,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-16 16:01:14,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-16 16:01:14,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:01:14,874 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:01:14,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-16 16:01:14,879 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:14,880 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:14,880 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879 empty. 2023-09-16 16:01:14,883 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:14,883 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-16 16:01:14,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-16 16:01:14,898 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:14,901 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:01:14,902 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-16 16:01:14,902 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/test.cache.data in system properties and HBase conf 2023-09-16 16:01:14,902 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop.tmp.dir in system properties and HBase conf 2023-09-16 16:01:14,902 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop.log.dir in system properties and HBase conf 2023-09-16 16:01:14,902 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-16 16:01:14,902 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-16 16:01:14,902 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/nfs.dump.dir in system properties and HBase conf 2023-09-16 16:01:14,903 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir in system properties and HBase conf 2023-09-16 16:01:14,904 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-16 16:01:14,904 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-16 16:01:14,904 INFO [Listener at localhost/36395] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-16 16:01:14,916 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-16 16:01:14,918 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 34849c70b7d6d975c8005f0d79ebc879, NAME => 'hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:14,945 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:14,945 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 34849c70b7d6d975c8005f0d79ebc879, disabling compactions & flushes 2023-09-16 16:01:14,945 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:01:14,945 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:01:14,945 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. after waiting 0 ms 2023-09-16 16:01:14,945 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:01:14,945 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:01:14,945 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 34849c70b7d6d975c8005f0d79ebc879: 2023-09-16 16:01:14,952 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:01:14,960 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694880074959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880074959"}]},"ts":"1694880074959"} 2023-09-16 16:01:14,972 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-16 16:01:14,974 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:01:14,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880074974"}]},"ts":"1694880074974"} 2023-09-16 16:01:14,978 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-16 16:01:14,984 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:01:14,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:01:14,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:01:14,986 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:01:14,986 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:01:14,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=34849c70b7d6d975c8005f0d79ebc879, ASSIGN}] 2023-09-16 16:01:14,992 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=34849c70b7d6d975c8005f0d79ebc879, ASSIGN 2023-09-16 16:01:14,994 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=34849c70b7d6d975c8005f0d79ebc879, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1694880072020; forceNewPlan=false, retain=false 2023-09-16 16:01:14,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-16 16:01:15,145 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-16 16:01:15,146 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=34849c70b7d6d975c8005f0d79ebc879, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:15,147 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694880075146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880075146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880075146"}]},"ts":"1694880075146"} 2023-09-16 16:01:15,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 34849c70b7d6d975c8005f0d79ebc879, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:01:15,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-16 16:01:15,312 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:01:15,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34849c70b7d6d975c8005f0d79ebc879, NAME => 'hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879.', STARTKEY => '', ENDKEY => ''} 2023-09-16 16:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. service=AccessControlService 2023-09-16 16:01:15,314 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:15,316 INFO [StoreOpener-34849c70b7d6d975c8005f0d79ebc879-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:15,319 DEBUG [StoreOpener-34849c70b7d6d975c8005f0d79ebc879-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/l 2023-09-16 16:01:15,319 DEBUG [StoreOpener-34849c70b7d6d975c8005f0d79ebc879-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/l 2023-09-16 16:01:15,320 INFO [StoreOpener-34849c70b7d6d975c8005f0d79ebc879-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34849c70b7d6d975c8005f0d79ebc879 columnFamilyName l 2023-09-16 16:01:15,320 INFO [StoreOpener-34849c70b7d6d975c8005f0d79ebc879-1] regionserver.HStore(310): Store=34849c70b7d6d975c8005f0d79ebc879/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:15,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:15,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:15,330 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:01:15,334 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:15,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34849c70b7d6d975c8005f0d79ebc879; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58950497, jitterRate=-0.12156914174556732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:15,336 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34849c70b7d6d975c8005f0d79ebc879: 2023-09-16 16:01:15,337 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879., pid=11, masterSystemTime=1694880075306 2023-09-16 16:01:15,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:01:15,340 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:01:15,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=34849c70b7d6d975c8005f0d79ebc879, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:15,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694880075341"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880075341"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880075341"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880075341"}]},"ts":"1694880075341"} 2023-09-16 16:01:15,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-16 16:01:15,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 34849c70b7d6d975c8005f0d79ebc879, server=jenkins-hbase4.apache.org,42403,1694880072020 in 194 msec 2023-09-16 16:01:15,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-16 16:01:15,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=34849c70b7d6d975c8005f0d79ebc879, ASSIGN in 363 msec 2023-09-16 16:01:15,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:01:15,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880075357"}]},"ts":"1694880075357"} 2023-09-16 16:01:15,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-16 16:01:15,363 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:01:15,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 497 msec 2023-09-16 16:01:15,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-16 16:01:15,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-16 16:01:15,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-16 16:01:16,191 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:16,562 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:16,568 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39225_jobhistory____h1y2g/webapp 2023-09-16 16:01:16,741 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-16 16:01:16,741 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-16 16:01:16,741 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-16 16:01:16,744 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-16 16:01:16,829 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:17,158 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:17,409 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-16 16:01:17,438 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39225 2023-09-16 16:01:17,686 WARN [Listener at jenkins-hbase4.apache.org/40461] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:17,946 WARN [Listener at jenkins-hbase4.apache.org/40461] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-16 16:01:17,946 INFO [Listener at jenkins-hbase4.apache.org/40461] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:17,956 INFO [Listener at jenkins-hbase4.apache.org/40461] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34577_cluster____e6qv68/webapp 2023-09-16 16:01:18,028 INFO [Listener at jenkins-hbase4.apache.org/40461] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-16 16:01:18,028 INFO [Listener at jenkins-hbase4.apache.org/40461] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-16 16:01:18,029 INFO [Listener at jenkins-hbase4.apache.org/40461] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-16 16:01:18,029 INFO [Listener at jenkins-hbase4.apache.org/40461] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-16 16:01:18,037 INFO [Listener at jenkins-hbase4.apache.org/40461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:18,264 INFO [Listener at jenkins-hbase4.apache.org/40461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:18,389 INFO [Listener at jenkins-hbase4.apache.org/40461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:18,402 INFO [Listener at jenkins-hbase4.apache.org/40461] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34577 2023-09-16 16:01:18,873 WARN [Listener at jenkins-hbase4.apache.org/32929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:18,939 WARN [Listener at jenkins-hbase4.apache.org/32929] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-16 16:01:18,940 INFO [Listener at jenkins-hbase4.apache.org/32929] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:18,949 INFO [Listener at jenkins-hbase4.apache.org/32929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36753_node____yodtlc/webapp 2023-09-16 16:01:19,008 INFO [Listener at jenkins-hbase4.apache.org/32929] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-16 16:01:19,009 INFO [Listener at jenkins-hbase4.apache.org/32929] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-16 16:01:19,009 INFO [Listener at jenkins-hbase4.apache.org/32929] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-16 16:01:19,009 INFO [Listener at jenkins-hbase4.apache.org/32929] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-16 16:01:19,019 INFO [Listener at jenkins-hbase4.apache.org/32929] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:19,042 INFO [Listener at jenkins-hbase4.apache.org/32929] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:19,114 INFO [Listener at jenkins-hbase4.apache.org/32929] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:19,124 INFO [Listener at jenkins-hbase4.apache.org/32929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36753 2023-09-16 16:01:19,287 WARN [Listener at jenkins-hbase4.apache.org/42447] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-16 16:01:19,296 WARN [Listener at jenkins-hbase4.apache.org/42447] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-16 16:01:19,297 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): jetty-6.1.26 2023-09-16 16:01:19,306 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37717_node____19wcfr/webapp 2023-09-16 16:01:19,360 INFO [Listener at jenkins-hbase4.apache.org/42447] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-16 16:01:19,361 INFO [Listener at jenkins-hbase4.apache.org/42447] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-16 16:01:19,361 INFO [Listener at jenkins-hbase4.apache.org/42447] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-16 16:01:19,361 INFO [Listener at jenkins-hbase4.apache.org/42447] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-16 16:01:19,368 INFO [Listener at jenkins-hbase4.apache.org/42447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:19,382 INFO [Listener at jenkins-hbase4.apache.org/42447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:19,443 INFO [Listener at jenkins-hbase4.apache.org/42447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-16 16:01:19,443 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:01:19,453 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37717 2023-09-16 16:01:19,511 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-16 16:01:19,513 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:01:19,581 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=165, AvailableMemoryMB=8248 2023-09-16 16:01:19,581 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-09-16 16:01:19,600 DEBUG [Listener at jenkins-hbase4.apache.org/42447] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-16 16:01:19,614 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-16 16:01:19,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-16 16:01:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:19,633 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:01:19,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-16 16:01:19,637 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:01:19,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-16 16:01:19,643 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:19,647 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-16 16:01:19,649 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6 empty. 2023-09-16 16:01:19,649 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:19,650 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-16 16:01:19,650 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:19,652 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a empty. 2023-09-16 16:01:19,652 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-16 16:01:19,653 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:19,653 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-16 16:01:19,684 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-16 16:01:19,685 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 20b2dac30627e58eee6d0d73b87f93f6, NAME => 'testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:19,686 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1aac1d6df981d169886abc46a42e2c2a, NAME => 'testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:19,715 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:19,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 20b2dac30627e58eee6d0d73b87f93f6, disabling compactions & flushes 2023-09-16 16:01:19,716 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:19,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:19,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. after waiting 0 ms 2023-09-16 16:01:19,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:19,716 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:19,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 20b2dac30627e58eee6d0d73b87f93f6: 2023-09-16 16:01:19,720 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:19,721 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 1aac1d6df981d169886abc46a42e2c2a, disabling compactions & flushes 2023-09-16 16:01:19,721 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:19,721 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:19,721 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. after waiting 0 ms 2023-09-16 16:01:19,721 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:19,721 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:19,721 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 1aac1d6df981d169886abc46a42e2c2a: 2023-09-16 16:01:19,725 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:01:19,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880079726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880079726"}]},"ts":"1694880079726"} 2023-09-16 16:01:19,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880079726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880079726"}]},"ts":"1694880079726"} 2023-09-16 16:01:19,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-16 16:01:19,773 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-16 16:01:19,774 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:01:19,774 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880079774"}]},"ts":"1694880079774"} 2023-09-16 16:01:19,777 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-16 16:01:19,781 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:01:19,783 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:01:19,784 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:01:19,784 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:01:19,784 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:01:19,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20b2dac30627e58eee6d0d73b87f93f6, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1aac1d6df981d169886abc46a42e2c2a, ASSIGN}] 2023-09-16 16:01:19,788 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1aac1d6df981d169886abc46a42e2c2a, ASSIGN 2023-09-16 16:01:19,788 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20b2dac30627e58eee6d0d73b87f93f6, ASSIGN 2023-09-16 16:01:19,789 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20b2dac30627e58eee6d0d73b87f93f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1694880072020; forceNewPlan=false, retain=false 2023-09-16 16:01:19,789 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1aac1d6df981d169886abc46a42e2c2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45159,1694880071982; forceNewPlan=false, retain=false 2023-09-16 16:01:19,939 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-16 16:01:19,942 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=20b2dac30627e58eee6d0d73b87f93f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:19,942 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1aac1d6df981d169886abc46a42e2c2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:19,942 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880079942"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880079942"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880079942"}]},"ts":"1694880079942"} 2023-09-16 16:01:19,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880079942"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880079942"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880079942"}]},"ts":"1694880079942"} 2023-09-16 16:01:19,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-16 16:01:19,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 20b2dac30627e58eee6d0d73b87f93f6, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:01:19,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 1aac1d6df981d169886abc46a42e2c2a, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:01:20,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:20,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20b2dac30627e58eee6d0d73b87f93f6, NAME => 'testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.', STARTKEY => '', ENDKEY => '1'} 2023-09-16 16:01:20,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. service=AccessControlService 2023-09-16 16:01:20,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:20,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:20,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:20,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:20,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:20,115 INFO [StoreOpener-20b2dac30627e58eee6d0d73b87f93f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:20,118 DEBUG [StoreOpener-20b2dac30627e58eee6d0d73b87f93f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf 2023-09-16 16:01:20,118 DEBUG [StoreOpener-20b2dac30627e58eee6d0d73b87f93f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf 2023-09-16 16:01:20,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:20,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1aac1d6df981d169886abc46a42e2c2a, NAME => 'testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.', STARTKEY => '1', ENDKEY => ''} 2023-09-16 16:01:20,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. service=AccessControlService 2023-09-16 16:01:20,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:20,123 INFO [StoreOpener-20b2dac30627e58eee6d0d73b87f93f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20b2dac30627e58eee6d0d73b87f93f6 columnFamilyName cf 2023-09-16 16:01:20,124 INFO [StoreOpener-1aac1d6df981d169886abc46a42e2c2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:20,126 INFO [StoreOpener-20b2dac30627e58eee6d0d73b87f93f6-1] regionserver.HStore(310): Store=20b2dac30627e58eee6d0d73b87f93f6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:20,131 DEBUG [StoreOpener-1aac1d6df981d169886abc46a42e2c2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf 2023-09-16 16:01:20,131 DEBUG [StoreOpener-1aac1d6df981d169886abc46a42e2c2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf 2023-09-16 16:01:20,131 INFO [StoreOpener-1aac1d6df981d169886abc46a42e2c2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1aac1d6df981d169886abc46a42e2c2a columnFamilyName cf 2023-09-16 16:01:20,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:20,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:20,133 INFO [StoreOpener-1aac1d6df981d169886abc46a42e2c2a-1] regionserver.HStore(310): Store=1aac1d6df981d169886abc46a42e2c2a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:20,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:20,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:20,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:20,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:20,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20b2dac30627e58eee6d0d73b87f93f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59213325, jitterRate=-0.11765269935131073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:20,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20b2dac30627e58eee6d0d73b87f93f6: 2023-09-16 16:01:20,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:20,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6., pid=15, masterSystemTime=1694880080098 2023-09-16 16:01:20,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:20,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:20,158 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=20b2dac30627e58eee6d0d73b87f93f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,158 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880080158"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880080158"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880080158"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880080158"}]},"ts":"1694880080158"} 2023-09-16 16:01:20,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:20,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1aac1d6df981d169886abc46a42e2c2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59363805, jitterRate=-0.11541037261486053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:20,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1aac1d6df981d169886abc46a42e2c2a: 2023-09-16 16:01:20,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a., pid=16, masterSystemTime=1694880080116 2023-09-16 16:01:20,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:20,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:20,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-16 16:01:20,166 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1aac1d6df981d169886abc46a42e2c2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,166 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 20b2dac30627e58eee6d0d73b87f93f6, server=jenkins-hbase4.apache.org,42403,1694880072020 in 216 msec 2023-09-16 16:01:20,166 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880080165"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880080165"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880080165"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880080165"}]},"ts":"1694880080165"} 2023-09-16 16:01:20,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20b2dac30627e58eee6d0d73b87f93f6, ASSIGN in 382 msec 2023-09-16 16:01:20,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-16 16:01:20,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 1aac1d6df981d169886abc46a42e2c2a, server=jenkins-hbase4.apache.org,45159,1694880071982 in 206 msec 2023-09-16 16:01:20,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-16 16:01:20,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1aac1d6df981d169886abc46a42e2c2a, ASSIGN in 392 msec 2023-09-16 16:01:20,181 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:01:20,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880080181"}]},"ts":"1694880080181"} 2023-09-16 16:01:20,183 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-16 16:01:20,187 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:01:20,192 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-16 16:01:20,201 DEBUG [hconnection-0x2999254c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:20,204 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-16 16:01:20,212 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-16 16:01:20,244 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:20,244 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:20,244 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:01:20,244 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:20,244 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:20,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-16 16:01:20,253 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:20,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:20,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:20,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:20,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:20,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 628 msec 2023-09-16 16:01:20,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-16 16:01:20,753 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-16 16:01:20,757 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-16 16:01:20,758 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:20,761 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:01:20,784 DEBUG [hconnection-0x1eb93e1b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:20,789 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:20,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-16 16:01:20,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880080805 (current time:1694880080805). 2023-09-16 16:01:20,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:01:20,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x7c590484 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:20,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60cdc6dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:20,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:20,817 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:20,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c590484 to 127.0.0.1:61309 2023-09-16 16:01:20,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:20,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x73ebcd49 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:20,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34fe8ba0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:20,829 DEBUG [hconnection-0x47a6a9ba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:20,830 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:20,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:20,836 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:20,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73ebcd49 to 127.0.0.1:61309 2023-09-16 16:01:20,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:20,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-16 16:01:20,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:01:20,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-16 16:01:20,873 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:01:20,874 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-16 16:01:20,874 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:01:20,874 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-16 16:01:20,874 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-16 16:01:20,875 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-16 16:01:20,875 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:01:20,875 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-16 16:01:20,875 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-16 16:01:20,875 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-16 16:01:20,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-16 16:01:20,890 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-16 16:01:20,891 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694880680891 2023-09-16 16:01:20,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-16 16:01:20,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-16 16:01:20,895 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-16 16:01:20,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-16 16:01:20,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-16 16:01:20,898 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-16 16:01:20,899 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694880680899 2023-09-16 16:01:20,899 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:01:20,899 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:01:20,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,930 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-16 16:01:20,930 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:20,930 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-16 16:01:20,930 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-16 16:01:20,931 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,931 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,939 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:20,939 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:20,940 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:20,939 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:20,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:20,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:20,940 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,940 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,941 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,941 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:01:20,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-16 16:01:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-16 16:01:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-16 16:01:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-16 16:01:20,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-16 16:01:20,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-16 16:01:20,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-16 16:01:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-16 16:01:20,952 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-16 16:01:20,952 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:20,952 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-16 16:01:20,952 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-16 16:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-16 16:01:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,956 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,956 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-16 16:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69a573a6[Count = 1] remaining members to acquire global barrier 2023-09-16 16:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:20,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-16 16:01:20,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69a573a6[Count = 0] remaining members to acquire global barrier 2023-09-16 16:01:20,962 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-16 16:01:20,963 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,967 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,967 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,967 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,968 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-16 16:01:20,968 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:20,968 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-16 16:01:20,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,968 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-16 16:01:20,968 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-16 16:01:20,968 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:01:20,968 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:20,968 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:01:20,969 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:20,969 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:20,969 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:20,969 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:20,969 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:20,969 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:20,970 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. started... 2023-09-16 16:01:20,970 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. started... 2023-09-16 16:01:20,970 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-16 16:01:20,970 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:20,970 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-16 16:01:20,974 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1aac1d6df981d169886abc46a42e2c2a: 2023-09-16 16:01:20,974 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20b2dac30627e58eee6d0d73b87f93f6: 2023-09-16 16:01:20,975 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,975 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:20,980 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:20,980 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:20,984 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:01:20,984 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:01:21,000 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:21,010 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. completed. 2023-09-16 16:01:21,010 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:21,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-16 16:01:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-16 16:01:21,015 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:01:21,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:21,017 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:01:21,018 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-16 16:01:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-16 16:01:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,021 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. completed. 2023-09-16 16:01:21,021 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:21,021 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:21,021 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:21,021 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,021 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-16 16:01:21,021 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:01:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,027 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,027 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-16 16:01:21,027 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:21,027 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-16 16:01:21,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42403,1694880072020': 2023-09-16 16:01:21,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-16 16:01:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:01:21,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-16 16:01:21,033 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-16 16:01:21,034 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:01:21,034 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:01:21,034 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,034 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:01:21,037 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,038 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,039 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,040 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,040 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,043 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,043 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,044 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,058 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,058 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,058 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,058 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,058 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,058 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,059 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,059 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,058 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,059 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:21,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,059 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-16 16:01:21,060 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,060 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,060 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:01:21,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,060 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,061 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,061 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,061 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-16 16:01:21,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-16 16:01:21,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,135 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:21,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694880080892Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694880081082 (+190 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694880081082Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694880081083 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694880081096 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694880081121 (+25 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694880081134 (+13 ms) 2023-09-16 16:01:21,137 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-16 16:01:21,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 243 msec 2023-09-16 16:01:21,217 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:21,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-16 16:01:21,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:01:21,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:01:21,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45159] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:01:21,243 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-16 16:01:21,244 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:21,244 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:01:21,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-16 16:01:21,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880081258 (current time:1694880081258). 2023-09-16 16:01:21,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:01:21,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x19154dc8 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:21,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b15a946, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:21,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:21,271 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:21,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19154dc8 to 127.0.0.1:61309 2023-09-16 16:01:21,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:21,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x040766fe to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:21,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37cf00bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:21,282 DEBUG [hconnection-0x7156c09d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:21,285 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:21,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:21,291 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x040766fe to 127.0.0.1:61309 2023-09-16 16:01:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-16 16:01:21,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:01:21,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-16 16:01:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-16 16:01:21,299 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-16 16:01:21,300 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694880681300 2023-09-16 16:01:21,300 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-16 16:01:21,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-16 16:01:21,301 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:01:21,301 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:01:21,303 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-16 16:01:21,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-16 16:01:21,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-16 16:01:21,305 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-16 16:01:21,306 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694880681306 2023-09-16 16:01:21,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-16 16:01:21,326 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-16 16:01:21,326 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:21,327 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-16 16:01:21,327 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-16 16:01:21,327 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,327 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,330 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,330 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,330 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,330 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,330 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,331 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,331 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,331 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:01:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-16 16:01:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-16 16:01:21,332 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-16 16:01:21,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-16 16:01:21,332 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:21,332 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-16 16:01:21,332 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-16 16:01:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-16 16:01:21,334 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-16 16:01:21,334 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-16 16:01:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:21,334 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-16 16:01:21,334 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-16 16:01:21,335 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-16 16:01:21,335 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-16 16:01:21,335 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-16 16:01:21,335 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-16 16:01:21,338 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,340 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,340 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:21,341 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,341 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:21,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-16 16:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b436ba[Count = 1] remaining members to acquire global barrier 2023-09-16 16:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-16 16:01:21,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b436ba[Count = 0] remaining members to acquire global barrier 2023-09-16 16:01:21,346 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-16 16:01:21,346 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-16 16:01:21,351 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-16 16:01:21,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,351 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,351 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-16 16:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-16 16:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:21,352 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,352 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:01:21,352 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:21,352 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:21,352 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. started... 2023-09-16 16:01:21,352 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. started... 2023-09-16 16:01:21,353 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20b2dac30627e58eee6d0d73b87f93f6 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-16 16:01:21,353 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1aac1d6df981d169886abc46a42e2c2a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-16 16:01:21,354 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-16 16:01:21,355 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:21,355 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-16 16:01:21,401 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:21,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-16 16:01:21,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:01:21,497 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091609c1aab0c5e344cfa924184424a807dc to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091609c1aab0c5e344cfa924184424a807dc 2023-09-16 16:01:21,497 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091666b4ed8a5acd4f92823b914bf27c20de to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091666b4ed8a5acd4f92823b914bf27c20de 2023-09-16 16:01:21,531 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/.tmp/cf/0782920ad9424e30b08015c62bf1e68e 2023-09-16 16:01:21,531 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/.tmp/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b 2023-09-16 16:01:21,542 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/.tmp/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b 2023-09-16 16:01:21,542 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/.tmp/cf/0782920ad9424e30b08015c62bf1e68e as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf/0782920ad9424e30b08015c62bf1e68e 2023-09-16 16:01:21,551 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b, entries=4, sequenceid=6, filesize=5.6 K 2023-09-16 16:01:21,552 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf/0782920ad9424e30b08015c62bf1e68e, entries=46, sequenceid=6, filesize=12.6 K 2023-09-16 16:01:21,556 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1aac1d6df981d169886abc46a42e2c2a in 203ms, sequenceid=6, compaction requested=false 2023-09-16 16:01:21,556 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 20b2dac30627e58eee6d0d73b87f93f6 in 203ms, sequenceid=6, compaction requested=false 2023-09-16 16:01:21,556 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-16 16:01:21,556 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-16 16:01:21,559 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20b2dac30627e58eee6d0d73b87f93f6: 2023-09-16 16:01:21,559 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1aac1d6df981d169886abc46a42e2c2a: 2023-09-16 16:01:21,559 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-16 16:01:21,559 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:21,559 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-16 16:01:21,560 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b] hfiles 2023-09-16 16:01:21,560 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:21,560 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b for snapshot=snaptb0-testExportWithTargetName 2023-09-16 16:01:21,560 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf/0782920ad9424e30b08015c62bf1e68e] hfiles 2023-09-16 16:01:21,560 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf/0782920ad9424e30b08015c62bf1e68e for snapshot=snaptb0-testExportWithTargetName 2023-09-16 16:01:21,583 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. completed. 2023-09-16 16:01:21,583 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-16 16:01:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:01:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-16 16:01:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-16 16:01:21,589 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,589 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. completed. 2023-09-16 16:01:21,589 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-16 16:01:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:01:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,592 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,592 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-16 16:01:21,592 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:21,592 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-16 16:01:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42403,1694880072020': 2023-09-16 16:01:21,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-16 16:01:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:01:21,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-16 16:01:21,600 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-16 16:01:21,600 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:01:21,600 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:01:21,600 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-16 16:01:21,600 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:01:21,602 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,602 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:21,603 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:21,603 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,604 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,604 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:21,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-16 16:01:21,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,606 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-16 16:01:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,607 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:21,608 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-16 16:01:21,608 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:21,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:21,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,618 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-16 16:01:21,618 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:21,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:21,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-16 16:01:21,619 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:21,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-16 16:01:21,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:21,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:01:21,620 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,621 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:21,621 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,621 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:21,621 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:21,621 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,621 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091609c1aab0c5e344cfa924184424a807dc, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091666b4ed8a5acd4f92823b914bf27c20de] mob files 2023-09-16 16:01:21,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091609c1aab0c5e344cfa924184424a807dc 2023-09-16 16:01:21,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091666b4ed8a5acd4f92823b914bf27c20de 2023-09-16 16:01:21,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-16 16:01:21,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-16 16:01:21,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,687 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-16 16:01:21,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694880081300Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694880081642 (+342 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694880081642Loading Region manifests for snaptb0-testExportWithTargetName at 1694880081642Writing data manifest for snaptb0-testExportWithTargetName at 1694880081647 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694880081667 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694880081686 (+19 ms) 2023-09-16 16:01:21,689 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-16 16:01:21,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 389 msec 2023-09-16 16:01:21,906 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:21,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-16 16:01:21,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:01:21,909 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909 2023-09-16 16:01:21,910 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42433, tgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909, rawTgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909, srcFsUri=hdfs://localhost:42433, srcDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:21,958 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:21,958 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1595751606_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-16 16:01:21,958 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, snapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-16 16:01:21,978 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-16 16:01:22,038 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:22,038 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:22,039 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:22,039 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:22,958 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-3298656531977459087.jar 2023-09-16 16:01:22,958 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:23,026 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-5762255536673380970.jar 2023-09-16 16:01:23,026 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:23,027 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:23,027 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:23,028 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:23,028 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:23,029 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:23,029 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-16 16:01:23,030 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-16 16:01:23,030 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-16 16:01:23,032 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-16 16:01:23,032 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-16 16:01:23,033 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-16 16:01:23,034 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-16 16:01:23,034 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-16 16:01:23,034 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-16 16:01:23,035 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-16 16:01:23,039 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:23,039 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:23,040 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:23,040 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:23,041 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:23,042 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:23,042 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:23,861 WARN [Listener at jenkins-hbase4.apache.org/42447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-16 16:01:23,867 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-16 16:01:23,875 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-16 16:01:24,331 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:01:24,332 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:01:24,637 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0001_000001 (auth:SIMPLE) 2023-09-16 16:01:25,617 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:01:28,977 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0001_000001 (auth:SIMPLE) 2023-09-16 16:01:31,224 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0001_000001 (auth:SIMPLE) 2023-09-16 16:01:34,632 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0001_000001 (auth:SIMPLE) 2023-09-16 16:01:36,728 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-16 16:01:36,731 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-16 16:01:36,741 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-16 16:01:36,741 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-16 16:01:36,742 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-16 16:01:36,742 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-16 16:01:36,743 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-16 16:01:36,743 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-16 16:01:36,743 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909/.hbase-snapshot/testExportWithTargetName 2023-09-16 16:01:36,744 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-16 16:01:36,744 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880081909/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-16 16:01:36,754 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-16 16:01:36,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-16 16:01:36,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:36,770 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880096770"}]},"ts":"1694880096770"} 2023-09-16 16:01:36,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-16 16:01:36,772 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-16 16:01:36,775 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-16 16:01:36,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20b2dac30627e58eee6d0d73b87f93f6, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1aac1d6df981d169886abc46a42e2c2a, UNASSIGN}] 2023-09-16 16:01:36,779 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20b2dac30627e58eee6d0d73b87f93f6, UNASSIGN 2023-09-16 16:01:36,779 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1aac1d6df981d169886abc46a42e2c2a, UNASSIGN 2023-09-16 16:01:36,780 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=20b2dac30627e58eee6d0d73b87f93f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:36,780 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1aac1d6df981d169886abc46a42e2c2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:36,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880096779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880096779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880096779"}]},"ts":"1694880096779"} 2023-09-16 16:01:36,780 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880096780"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880096780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880096780"}]},"ts":"1694880096780"} 2023-09-16 16:01:36,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 20b2dac30627e58eee6d0d73b87f93f6, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:01:36,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 1aac1d6df981d169886abc46a42e2c2a, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:01:36,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-16 16:01:36,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:36,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:36,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1aac1d6df981d169886abc46a42e2c2a, disabling compactions & flushes 2023-09-16 16:01:36,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20b2dac30627e58eee6d0d73b87f93f6, disabling compactions & flushes 2023-09-16 16:01:36,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:36,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. after waiting 0 ms 2023-09-16 16:01:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. after waiting 0 ms 2023-09-16 16:01:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:36,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:01:36,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:01:36,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:01:36,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:01:36,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6. 2023-09-16 16:01:36,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a. 2023-09-16 16:01:36,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20b2dac30627e58eee6d0d73b87f93f6: 2023-09-16 16:01:36,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1aac1d6df981d169886abc46a42e2c2a: 2023-09-16 16:01:36,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:36,967 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=20b2dac30627e58eee6d0d73b87f93f6, regionState=CLOSED 2023-09-16 16:01:36,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:36,968 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880096967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880096967"}]},"ts":"1694880096967"} 2023-09-16 16:01:36,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1aac1d6df981d169886abc46a42e2c2a, regionState=CLOSED 2023-09-16 16:01:36,969 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694880096968"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880096968"}]},"ts":"1694880096968"} 2023-09-16 16:01:36,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-16 16:01:36,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 20b2dac30627e58eee6d0d73b87f93f6, server=jenkins-hbase4.apache.org,42403,1694880072020 in 188 msec 2023-09-16 16:01:36,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-16 16:01:36,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 1aac1d6df981d169886abc46a42e2c2a, server=jenkins-hbase4.apache.org,45159,1694880071982 in 189 msec 2023-09-16 16:01:36,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20b2dac30627e58eee6d0d73b87f93f6, UNASSIGN in 197 msec 2023-09-16 16:01:36,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-16 16:01:36,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1aac1d6df981d169886abc46a42e2c2a, UNASSIGN in 199 msec 2023-09-16 16:01:36,979 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880096979"}]},"ts":"1694880096979"} 2023-09-16 16:01:36,981 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-16 16:01:36,984 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-16 16:01:36,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-09-16 16:01:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-16 16:01:37,075 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-16 16:01:37,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-16 16:01:37,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:37,090 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:37,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-16 16:01:37,092 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:37,095 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-16 16:01:37,098 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:37,098 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:37,098 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:37,098 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:37,098 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:37,099 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:37,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-16 16:01:37,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-16 16:01:37,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-16 16:01:37,100 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:37,100 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,100 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,101 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:37,101 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,101 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-16 16:01:37,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-16 16:01:37,101 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,101 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-16 16:01:37,103 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/recovered.edits] 2023-09-16 16:01:37,103 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/recovered.edits] 2023-09-16 16:01:37,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-16 16:01:37,111 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/cf/db0f6f6f5a4a45b7b6bbbd9b6297f97b 2023-09-16 16:01:37,111 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf/0782920ad9424e30b08015c62bf1e68e to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/cf/0782920ad9424e30b08015c62bf1e68e 2023-09-16 16:01:37,115 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6/recovered.edits/9.seqid 2023-09-16 16:01:37,115 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a/recovered.edits/9.seqid 2023-09-16 16:01:37,116 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/20b2dac30627e58eee6d0d73b87f93f6 2023-09-16 16:01:37,116 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportWithTargetName/1aac1d6df981d169886abc46a42e2c2a 2023-09-16 16:01:37,116 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-16 16:01:37,117 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-16 16:01:37,118 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-16 16:01:37,123 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091609c1aab0c5e344cfa924184424a807dc to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091609c1aab0c5e344cfa924184424a807dc 2023-09-16 16:01:37,125 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091666b4ed8a5acd4f92823b914bf27c20de to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091666b4ed8a5acd4f92823b914bf27c20de 2023-09-16 16:01:37,125 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-16 16:01:37,128 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:37,150 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-16 16:01:37,153 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-16 16:01:37,155 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:37,155 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-16 16:01:37,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880097155"}]},"ts":"9223372036854775807"} 2023-09-16 16:01:37,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880097155"}]},"ts":"9223372036854775807"} 2023-09-16 16:01:37,158 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-16 16:01:37,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 20b2dac30627e58eee6d0d73b87f93f6, NAME => 'testtb-testExportWithTargetName,,1694880079626.20b2dac30627e58eee6d0d73b87f93f6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1aac1d6df981d169886abc46a42e2c2a, NAME => 'testtb-testExportWithTargetName,1,1694880079626.1aac1d6df981d169886abc46a42e2c2a.', STARTKEY => '1', ENDKEY => ''}] 2023-09-16 16:01:37,158 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-16 16:01:37,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694880097158"}]},"ts":"9223372036854775807"} 2023-09-16 16:01:37,160 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-16 16:01:37,163 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-16 16:01:37,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 82 msec 2023-09-16 16:01:37,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-16 16:01:37,208 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-16 16:01:37,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-16 16:01:37,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-16 16:01:37,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-16 16:01:37,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-16 16:01:37,262 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 707) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:32929 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:41257 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-869380492_1 at /127.0.0.1:57292 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:55352 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:58564 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:39703 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:36130 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 165) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=7419 (was 8248) 2023-09-16 16:01:37,263 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-16 16:01:37,282 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=7418 2023-09-16 16:01:37,282 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-16 16:01:37,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-16 16:01:37,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:37,289 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:01:37,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-16 16:01:37,291 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:01:37,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-16 16:01:37,294 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,294 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,295 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b empty. 2023-09-16 16:01:37,295 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314 empty. 2023-09-16 16:01:37,295 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,295 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,295 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-16 16:01:37,307 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-16 16:01:37,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 610c0a8968228fae70aa3b1ea654927b, NAME => 'testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:37,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 78d8f58a0dde657a907843ac92914314, NAME => 'testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:37,334 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:37,334 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 78d8f58a0dde657a907843ac92914314, disabling compactions & flushes 2023-09-16 16:01:37,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:37,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:37,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. after waiting 0 ms 2023-09-16 16:01:37,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:37,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:37,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 78d8f58a0dde657a907843ac92914314: 2023-09-16 16:01:37,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:37,336 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 610c0a8968228fae70aa3b1ea654927b, disabling compactions & flushes 2023-09-16 16:01:37,336 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,336 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,336 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. after waiting 0 ms 2023-09-16 16:01:37,336 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,336 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,336 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 610c0a8968228fae70aa3b1ea654927b: 2023-09-16 16:01:37,339 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:01:37,340 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880097340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880097340"}]},"ts":"1694880097340"} 2023-09-16 16:01:37,341 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880097340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880097340"}]},"ts":"1694880097340"} 2023-09-16 16:01:37,343 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-16 16:01:37,344 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:01:37,344 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880097344"}]},"ts":"1694880097344"} 2023-09-16 16:01:37,345 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-16 16:01:37,348 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:01:37,350 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:01:37,350 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:01:37,350 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:01:37,350 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:01:37,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610c0a8968228fae70aa3b1ea654927b, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=78d8f58a0dde657a907843ac92914314, ASSIGN}] 2023-09-16 16:01:37,352 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=78d8f58a0dde657a907843ac92914314, ASSIGN 2023-09-16 16:01:37,352 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610c0a8968228fae70aa3b1ea654927b, ASSIGN 2023-09-16 16:01:37,353 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=78d8f58a0dde657a907843ac92914314, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1694880072020; forceNewPlan=false, retain=false 2023-09-16 16:01:37,353 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610c0a8968228fae70aa3b1ea654927b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45159,1694880071982; forceNewPlan=false, retain=false 2023-09-16 16:01:37,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-16 16:01:37,505 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-16 16:01:37,506 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=610c0a8968228fae70aa3b1ea654927b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:37,506 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=78d8f58a0dde657a907843ac92914314, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:37,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880097506"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880097506"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880097506"}]},"ts":"1694880097506"} 2023-09-16 16:01:37,507 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880097506"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880097506"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880097506"}]},"ts":"1694880097506"} 2023-09-16 16:01:37,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 610c0a8968228fae70aa3b1ea654927b, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:01:37,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 78d8f58a0dde657a907843ac92914314, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:01:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-16 16:01:37,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 610c0a8968228fae70aa3b1ea654927b, NAME => 'testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.', STARTKEY => '', ENDKEY => '1'} 2023-09-16 16:01:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78d8f58a0dde657a907843ac92914314, NAME => 'testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.', STARTKEY => '1', ENDKEY => ''} 2023-09-16 16:01:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. service=AccessControlService 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. service=AccessControlService 2023-09-16 16:01:37,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:37,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,669 INFO [StoreOpener-78d8f58a0dde657a907843ac92914314-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,669 INFO [StoreOpener-610c0a8968228fae70aa3b1ea654927b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,670 DEBUG [StoreOpener-78d8f58a0dde657a907843ac92914314-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf 2023-09-16 16:01:37,670 DEBUG [StoreOpener-78d8f58a0dde657a907843ac92914314-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf 2023-09-16 16:01:37,670 DEBUG [StoreOpener-610c0a8968228fae70aa3b1ea654927b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf 2023-09-16 16:01:37,670 DEBUG [StoreOpener-610c0a8968228fae70aa3b1ea654927b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf 2023-09-16 16:01:37,671 INFO [StoreOpener-610c0a8968228fae70aa3b1ea654927b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 610c0a8968228fae70aa3b1ea654927b columnFamilyName cf 2023-09-16 16:01:37,671 INFO [StoreOpener-78d8f58a0dde657a907843ac92914314-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78d8f58a0dde657a907843ac92914314 columnFamilyName cf 2023-09-16 16:01:37,673 INFO [StoreOpener-610c0a8968228fae70aa3b1ea654927b-1] regionserver.HStore(310): Store=610c0a8968228fae70aa3b1ea654927b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:37,673 INFO [StoreOpener-78d8f58a0dde657a907843ac92914314-1] regionserver.HStore(310): Store=78d8f58a0dde657a907843ac92914314/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:37,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:37,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:37,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:37,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 610c0a8968228fae70aa3b1ea654927b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73117231, jitterRate=0.08953164517879486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:37,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 610c0a8968228fae70aa3b1ea654927b: 2023-09-16 16:01:37,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b., pid=30, masterSystemTime=1694880097661 2023-09-16 16:01:37,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,687 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=610c0a8968228fae70aa3b1ea654927b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:37,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880097687"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880097687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880097687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880097687"}]},"ts":"1694880097687"} 2023-09-16 16:01:37,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:37,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78d8f58a0dde657a907843ac92914314; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66318338, jitterRate=-0.011779755353927612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:37,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78d8f58a0dde657a907843ac92914314: 2023-09-16 16:01:37,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314., pid=31, masterSystemTime=1694880097663 2023-09-16 16:01:37,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:37,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:37,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-16 16:01:37,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 610c0a8968228fae70aa3b1ea654927b, server=jenkins-hbase4.apache.org,45159,1694880071982 in 181 msec 2023-09-16 16:01:37,694 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=78d8f58a0dde657a907843ac92914314, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:37,694 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880097694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880097694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880097694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880097694"}]},"ts":"1694880097694"} 2023-09-16 16:01:37,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610c0a8968228fae70aa3b1ea654927b, ASSIGN in 344 msec 2023-09-16 16:01:37,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-16 16:01:37,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 78d8f58a0dde657a907843ac92914314, server=jenkins-hbase4.apache.org,42403,1694880072020 in 186 msec 2023-09-16 16:01:37,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-16 16:01:37,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=78d8f58a0dde657a907843ac92914314, ASSIGN in 352 msec 2023-09-16 16:01:37,705 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:01:37,705 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880097705"}]},"ts":"1694880097705"} 2023-09-16 16:01:37,707 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-16 16:01:37,711 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:01:37,711 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-16 16:01:37,713 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-16 16:01:37,714 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,714 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,714 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,714 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:37,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:37,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:37,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:37,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:37,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 429 msec 2023-09-16 16:01:37,720 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-16 16:01:37,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-16 16:01:37,896 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-16 16:01:37,899 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-16 16:01:37,899 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:37,902 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:01:37,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:01:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880097919 (current time:1694880097919). 2023-09-16 16:01:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:01:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x012f061f to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23181267, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:37,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:37,929 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:37,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x012f061f to 127.0.0.1:61309 2023-09-16 16:01:37,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:37,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x5b7a36dd to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:37,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@221cdc53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:37,941 DEBUG [hconnection-0x4174795d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:37,944 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:37,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:37,951 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:37,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b7a36dd to 127.0.0.1:61309 2023-09-16 16:01:37,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:37,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-16 16:01:37,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:01:37,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:01:37,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:01:37,957 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:01:37,958 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694880697958 2023-09-16 16:01:37,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:01:37,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-16 16:01:37,960 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:01:37,960 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:01:37,961 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:01:37,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-16 16:01:37,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-16 16:01:37,964 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-16 16:01:37,965 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694880697965 2023-09-16 16:01:37,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,986 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-16 16:01:37,986 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:37,987 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-16 16:01:37,987 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-16 16:01:37,988 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,988 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:37,989 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:37,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:37,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:37,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:37,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:37,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,990 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:37,990 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:37,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-16 16:01:37,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,991 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-16 16:01:37,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,992 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-16 16:01:37,992 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:37,992 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:37,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,993 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:01:37,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-16 16:01:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,993 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-16 16:01:37,994 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-16 16:01:37,994 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-16 16:01:37,994 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-16 16:01:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-16 16:01:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,994 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-16 16:01:37,994 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-16 16:01:37,994 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:37,997 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:37,997 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:37,998 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-16 16:01:37,998 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:37,998 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-16 16:01:37,999 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-16 16:01:37,999 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:37,999 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-16 16:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:37,999 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-16 16:01:37,999 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:37,999 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-16 16:01:37,999 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-16 16:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,006 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,006 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-16 16:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771c6e1f[Count = 1] remaining members to acquire global barrier 2023-09-16 16:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-16 16:01:38,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771c6e1f[Count = 0] remaining members to acquire global barrier 2023-09-16 16:01:38,011 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-16 16:01:38,011 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:01:38,013 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,012 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:38,013 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:38,013 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,013 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:01:38,013 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-16 16:01:38,013 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. started... 2023-09-16 16:01:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:01:38,013 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. started... 2023-09-16 16:01:38,014 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 610c0a8968228fae70aa3b1ea654927b: 2023-09-16 16:01:38,015 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78d8f58a0dde657a907843ac92914314: 2023-09-16 16:01:38,015 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,015 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:38,015 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,015 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:01:38,015 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:38,015 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:01:38,017 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-16 16:01:38,017 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,017 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-16 16:01:38,045 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. completed. 2023-09-16 16:01:38,045 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-16 16:01:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:01:38,048 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,048 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-16 16:01:38,048 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. completed. 2023-09-16 16:01:38,048 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,049 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-16 16:01:38,048 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:38,050 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:38,050 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:38,050 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,050 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-16 16:01:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,050 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:01:38,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,052 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-16 16:01:38,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-16 16:01:38,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:01:38,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-16 16:01:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,060 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42403,1694880072020': 2023-09-16 16:01:38,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-16 16:01:38,061 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-16 16:01:38,061 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:01:38,061 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:01:38,061 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,061 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:01:38,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:01:38,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:38,062 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:01:38,063 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,063 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,063 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,063 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,063 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,063 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,065 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,064 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,065 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,066 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,068 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,069 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,069 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,076 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,076 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-16 16:01:38,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:01:38,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-16 16:01:38,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-16 16:01:38,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,131 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:38,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694880097959Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694880098090 (+131 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694880098090Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694880098091 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694880098097 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694880098120 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694880098130 (+10 ms) 2023-09-16 16:01:38,134 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-16 16:01:38,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 174 msec 2023-09-16 16:01:38,262 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:38,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:01:38,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:01:38,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45159] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:01:38,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:01:38,276 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-16 16:01:38,277 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:38,277 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:01:38,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:01:38,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880098291 (current time:1694880098291). 2023-09-16 16:01:38,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:01:38,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x369e14d0 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:38,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5808a203, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:38,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:38,307 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:38,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x369e14d0 to 127.0.0.1:61309 2023-09-16 16:01:38,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:38,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x4963baef to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:38,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1218accd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:38,318 DEBUG [hconnection-0x5998b9b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:38,320 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:38,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:38,326 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4963baef to 127.0.0.1:61309 2023-09-16 16:01:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-16 16:01:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:01:38,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:01:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:01:38,333 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:01:38,334 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694880698334 2023-09-16 16:01:38,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:01:38,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-16 16:01:38,336 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:01:38,336 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:01:38,337 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:01:38,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-16 16:01:38,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-16 16:01:38,340 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-16 16:01:38,340 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694880698340 2023-09-16 16:01:38,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-16 16:01:38,359 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-16 16:01:38,359 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:38,361 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-16 16:01:38,361 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-16 16:01:38,361 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,361 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,364 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,364 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,364 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,364 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,364 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,364 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,365 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,365 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:01:38,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-16 16:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-16 16:01:38,366 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-16 16:01:38,366 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:38,366 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-16 16:01:38,368 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-16 16:01:38,368 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-16 16:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-16 16:01:38,368 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-16 16:01:38,368 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,369 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-16 16:01:38,369 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-16 16:01:38,369 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-16 16:01:38,369 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-16 16:01:38,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-16 16:01:38,369 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-16 16:01:38,369 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:38,370 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-16 16:01:38,370 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-16 16:01:38,370 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-16 16:01:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,371 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,372 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:38,372 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,372 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:38,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,373 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,373 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,373 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,373 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:38,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-16 16:01:38,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b45d950[Count = 1] remaining members to acquire global barrier 2023-09-16 16:01:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-16 16:01:38,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b45d950[Count = 0] remaining members to acquire global barrier 2023-09-16 16:01:38,377 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-16 16:01:38,378 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:01:38,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-16 16:01:38,385 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:01:38,385 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:01:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,385 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,386 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:01:38,386 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:38,386 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:38,386 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:01:38,386 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:38,386 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. started... 2023-09-16 16:01:38,386 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:38,386 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:38,386 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:38,386 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 610c0a8968228fae70aa3b1ea654927b 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-16 16:01:38,386 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. started... 2023-09-16 16:01:38,386 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 78d8f58a0dde657a907843ac92914314 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-16 16:01:38,387 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-16 16:01:38,387 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,387 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-16 16:01:38,431 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309166c8d6895a34a40d98f493607bd73fe7c to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309166c8d6895a34a40d98f493607bd73fe7c 2023-09-16 16:01:38,436 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:38,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:01:38,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:38,437 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:01:38,444 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/.tmp/cf/0fbfd48465d04b5ba73145c0b50d18a2 2023-09-16 16:01:38,450 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/.tmp/cf/0fbfd48465d04b5ba73145c0b50d18a2 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf/0fbfd48465d04b5ba73145c0b50d18a2 2023-09-16 16:01:38,457 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf/0fbfd48465d04b5ba73145c0b50d18a2, entries=3, sequenceid=6, filesize=5.4 K 2023-09-16 16:01:38,458 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 610c0a8968228fae70aa3b1ea654927b in 72ms, sequenceid=6, compaction requested=false 2023-09-16 16:01:38,460 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 610c0a8968228fae70aa3b1ea654927b: 2023-09-16 16:01:38,460 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-16 16:01:38,460 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:38,460 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf/0fbfd48465d04b5ba73145c0b50d18a2] hfiles 2023-09-16 16:01:38,460 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf/0fbfd48465d04b5ba73145c0b50d18a2 for snapshot=snaptb0-testExportFileSystemState 2023-09-16 16:01:38,471 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. completed. 2023-09-16 16:01:38,471 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:38,471 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:38,471 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:38,471 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,471 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-16 16:01:38,471 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:01:38,476 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-16 16:01:38,476 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,476 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,476 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-16 16:01:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:01:38,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-16 16:01:38,638 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:38,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:01:38,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:38,639 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-16 16:01:38,826 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230916702d1f065a414f51a22363d643fa6b53 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230916702d1f065a414f51a22363d643fa6b53 2023-09-16 16:01:38,835 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/.tmp/cf/50def82420a54e9696ff3a648321aa99 2023-09-16 16:01:38,841 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/.tmp/cf/50def82420a54e9696ff3a648321aa99 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf/50def82420a54e9696ff3a648321aa99 2023-09-16 16:01:38,846 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf/50def82420a54e9696ff3a648321aa99, entries=47, sequenceid=6, filesize=12.8 K 2023-09-16 16:01:38,847 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 78d8f58a0dde657a907843ac92914314 in 461ms, sequenceid=6, compaction requested=false 2023-09-16 16:01:38,847 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78d8f58a0dde657a907843ac92914314: 2023-09-16 16:01:38,848 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-16 16:01:38,848 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:38,848 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf/50def82420a54e9696ff3a648321aa99] hfiles 2023-09-16 16:01:38,848 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf/50def82420a54e9696ff3a648321aa99 for snapshot=snaptb0-testExportFileSystemState 2023-09-16 16:01:38,857 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. completed. 2023-09-16 16:01:38,857 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:38,858 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:38,858 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:38,858 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,858 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-16 16:01:38,858 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:01:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-16 16:01:38,860 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-16 16:01:38,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42403,1694880072020': 2023-09-16 16:01:38,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-16 16:01:38,865 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-16 16:01:38,865 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:01:38,865 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:01:38,865 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-16 16:01:38,865 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:01:38,867 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,867 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,867 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:38,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:38,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,868 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:38,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,868 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,869 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,871 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:38,871 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-16 16:01:38,872 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,875 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:38,877 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-16 16:01:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:38,875 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-16 16:01:38,877 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:38,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-16 16:01:38,877 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:38,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:01:38,878 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,878 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:38,878 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:38,878 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,879 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230916702d1f065a414f51a22363d643fa6b53, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309166c8d6895a34a40d98f493607bd73fe7c] mob files 2023-09-16 16:01:38,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230916702d1f065a414f51a22363d643fa6b53 2023-09-16 16:01:38,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309166c8d6895a34a40d98f493607bd73fe7c 2023-09-16 16:01:38,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-16 16:01:38,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-16 16:01:38,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,912 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694880098334Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694880098887 (+553 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694880098887Loading Region manifests for snaptb0-testExportFileSystemState at 1694880098887Writing data manifest for snaptb0-testExportFileSystemState at 1694880098891 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694880098902 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694880098912 (+10 ms) 2023-09-16 16:01:38,915 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-16 16:01:38,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 580 msec 2023-09-16 16:01:38,939 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:38,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:01:38,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:01:38,941 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941 2023-09-16 16:01:38,941 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42433, tgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941, rawTgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941, srcFsUri=hdfs://localhost:42433, srcDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:38,967 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:38,967 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_261615209_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-16 16:01:38,967 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, snapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-16 16:01:38,982 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-16 16:01:39,016 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,016 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,017 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,017 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,909 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-4836782032966923775.jar 2023-09-16 16:01:39,909 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,909 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,979 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-7329262375320887135.jar 2023-09-16 16:01:39,980 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,980 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,980 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,981 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,982 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,982 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:39,983 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-16 16:01:39,983 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-16 16:01:39,984 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-16 16:01:39,984 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-16 16:01:39,984 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-16 16:01:39,985 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-16 16:01:39,985 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-16 16:01:39,986 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-16 16:01:39,986 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-16 16:01:39,986 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-16 16:01:39,987 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:39,987 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:39,988 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:39,988 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:39,988 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:39,989 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:39,990 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:40,448 WARN [Listener at jenkins-hbase4.apache.org/42447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-16 16:01:40,451 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-16 16:01:40,453 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-16 16:01:40,841 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:01:40,841 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:01:40,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0001_000001 (auth:SIMPLE) 2023-09-16 16:01:41,607 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0002_000001 (auth:SIMPLE) 2023-09-16 16:01:42,575 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:01:45,635 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0002_000001 (auth:SIMPLE) 2023-09-16 16:01:47,872 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0002_000001 (auth:SIMPLE) 2023-09-16 16:01:50,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0002_000001 (auth:SIMPLE) 2023-09-16 16:01:52,643 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-16 16:01:52,644 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-16 16:01:52,652 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-16 16:01:52,652 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-16 16:01:52,653 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-16 16:01:52,653 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-16 16:01:52,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-16 16:01:52,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-16 16:01:52,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-16 16:01:52,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-16 16:01:52,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880098941/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-16 16:01:52,661 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-16 16:01:52,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-16 16:01:52,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:52,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-16 16:01:52,666 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880112666"}]},"ts":"1694880112666"} 2023-09-16 16:01:52,668 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-16 16:01:52,670 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-16 16:01:52,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610c0a8968228fae70aa3b1ea654927b, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=78d8f58a0dde657a907843ac92914314, UNASSIGN}] 2023-09-16 16:01:52,673 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=78d8f58a0dde657a907843ac92914314, UNASSIGN 2023-09-16 16:01:52,673 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610c0a8968228fae70aa3b1ea654927b, UNASSIGN 2023-09-16 16:01:52,674 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=78d8f58a0dde657a907843ac92914314, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:52,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=610c0a8968228fae70aa3b1ea654927b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:52,674 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880112673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880112673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880112673"}]},"ts":"1694880112673"} 2023-09-16 16:01:52,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880112674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880112674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880112674"}]},"ts":"1694880112674"} 2023-09-16 16:01:52,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 78d8f58a0dde657a907843ac92914314, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:01:52,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 610c0a8968228fae70aa3b1ea654927b, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:01:52,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-16 16:01:52,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:52,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78d8f58a0dde657a907843ac92914314, disabling compactions & flushes 2023-09-16 16:01:52,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:52,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:52,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. after waiting 0 ms 2023-09-16 16:01:52,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:52,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:52,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 610c0a8968228fae70aa3b1ea654927b, disabling compactions & flushes 2023-09-16 16:01:52,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:52,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:52,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. after waiting 0 ms 2023-09-16 16:01:52,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:52,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:01:52,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:01:52,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:01:52,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:01:52,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314. 2023-09-16 16:01:52,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78d8f58a0dde657a907843ac92914314: 2023-09-16 16:01:52,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b. 2023-09-16 16:01:52,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 610c0a8968228fae70aa3b1ea654927b: 2023-09-16 16:01:52,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:52,844 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=78d8f58a0dde657a907843ac92914314, regionState=CLOSED 2023-09-16 16:01:52,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:52,844 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880112844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880112844"}]},"ts":"1694880112844"} 2023-09-16 16:01:52,845 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=610c0a8968228fae70aa3b1ea654927b, regionState=CLOSED 2023-09-16 16:01:52,845 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694880112845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880112845"}]},"ts":"1694880112845"} 2023-09-16 16:01:52,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-16 16:01:52,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 78d8f58a0dde657a907843ac92914314, server=jenkins-hbase4.apache.org,42403,1694880072020 in 171 msec 2023-09-16 16:01:52,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-16 16:01:52,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 610c0a8968228fae70aa3b1ea654927b, server=jenkins-hbase4.apache.org,45159,1694880071982 in 171 msec 2023-09-16 16:01:52,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=78d8f58a0dde657a907843ac92914314, UNASSIGN in 177 msec 2023-09-16 16:01:52,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-16 16:01:52,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610c0a8968228fae70aa3b1ea654927b, UNASSIGN in 178 msec 2023-09-16 16:01:52,852 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880112852"}]},"ts":"1694880112852"} 2023-09-16 16:01:52,853 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-16 16:01:52,855 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-16 16:01:52,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-16 16:01:52,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-16 16:01:52,969 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-16 16:01:52,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-16 16:01:52,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:52,973 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:52,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-16 16:01:52,974 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:52,976 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-16 16:01:52,980 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:52,980 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:52,980 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,980 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,980 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,980 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-16 16:01:52,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-16 16:01:52,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-16 16:01:52,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:52,982 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:52,982 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/recovered.edits] 2023-09-16 16:01:52,983 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/recovered.edits] 2023-09-16 16:01:52,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-16 16:01:52,987 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf/0fbfd48465d04b5ba73145c0b50d18a2 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/cf/0fbfd48465d04b5ba73145c0b50d18a2 2023-09-16 16:01:52,987 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf/50def82420a54e9696ff3a648321aa99 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/cf/50def82420a54e9696ff3a648321aa99 2023-09-16 16:01:52,991 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b/recovered.edits/9.seqid 2023-09-16 16:01:52,992 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314/recovered.edits/9.seqid 2023-09-16 16:01:52,992 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/610c0a8968228fae70aa3b1ea654927b 2023-09-16 16:01:52,992 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemState/78d8f58a0dde657a907843ac92914314 2023-09-16 16:01:52,992 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-16 16:01:52,993 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-16 16:01:52,993 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-16 16:01:52,997 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230916702d1f065a414f51a22363d643fa6b53 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230916702d1f065a414f51a22363d643fa6b53 2023-09-16 16:01:52,999 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309166c8d6895a34a40d98f493607bd73fe7c to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309166c8d6895a34a40d98f493607bd73fe7c 2023-09-16 16:01:52,999 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-16 16:01:53,002 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:53,004 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-16 16:01:53,008 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-16 16:01:53,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:53,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-16 16:01:53,010 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880113010"}]},"ts":"9223372036854775807"} 2023-09-16 16:01:53,010 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880113010"}]},"ts":"9223372036854775807"} 2023-09-16 16:01:53,012 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-16 16:01:53,012 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 610c0a8968228fae70aa3b1ea654927b, NAME => 'testtb-testExportFileSystemState,,1694880097284.610c0a8968228fae70aa3b1ea654927b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 78d8f58a0dde657a907843ac92914314, NAME => 'testtb-testExportFileSystemState,1,1694880097284.78d8f58a0dde657a907843ac92914314.', STARTKEY => '1', ENDKEY => ''}] 2023-09-16 16:01:53,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-16 16:01:53,012 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694880113012"}]},"ts":"9223372036854775807"} 2023-09-16 16:01:53,014 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-16 16:01:53,016 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-16 16:01:53,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-09-16 16:01:53,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-16 16:01:53,084 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-16 16:01:53,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-16 16:01:53,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-16 16:01:53,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-16 16:01:53,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-16 16:01:53,122 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 754) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1036556880_1 at /127.0.0.1:53346 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:42447 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:53384 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2077 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:41627 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:52360 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:44408 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 927) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 202) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7281 (was 7418) 2023-09-16 16:01:53,122 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-16 16:01:53,141 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=168, AvailableMemoryMB=7280 2023-09-16 16:01:53,141 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-16 16:01:53,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-16 16:01:53,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:01:53,147 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:01:53,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-16 16:01:53,147 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:01:53,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-16 16:01:53,150 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,150 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,151 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9 empty. 2023-09-16 16:01:53,151 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca empty. 2023-09-16 16:01:53,151 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,151 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,151 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-16 16:01:53,163 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-16 16:01:53,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b46fb815fcab164f6332e8bbe5d6e1e9, NAME => 'testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:53,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 07b2aef2597a17481b97a27e878413ca, NAME => 'testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:01:53,177 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:53,177 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 07b2aef2597a17481b97a27e878413ca, disabling compactions & flushes 2023-09-16 16:01:53,177 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:53,177 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,177 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b46fb815fcab164f6332e8bbe5d6e1e9, disabling compactions & flushes 2023-09-16 16:01:53,177 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,178 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,178 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. after waiting 0 ms 2023-09-16 16:01:53,178 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,178 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,178 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. after waiting 0 ms 2023-09-16 16:01:53,178 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,178 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,178 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 07b2aef2597a17481b97a27e878413ca: 2023-09-16 16:01:53,178 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,178 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b46fb815fcab164f6332e8bbe5d6e1e9: 2023-09-16 16:01:53,181 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:01:53,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880113182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880113182"}]},"ts":"1694880113182"} 2023-09-16 16:01:53,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880113182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880113182"}]},"ts":"1694880113182"} 2023-09-16 16:01:53,184 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-16 16:01:53,185 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:01:53,186 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880113185"}]},"ts":"1694880113185"} 2023-09-16 16:01:53,187 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-16 16:01:53,190 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:01:53,192 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:01:53,192 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:01:53,192 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:01:53,192 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:01:53,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b46fb815fcab164f6332e8bbe5d6e1e9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07b2aef2597a17481b97a27e878413ca, ASSIGN}] 2023-09-16 16:01:53,197 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07b2aef2597a17481b97a27e878413ca, ASSIGN 2023-09-16 16:01:53,197 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b46fb815fcab164f6332e8bbe5d6e1e9, ASSIGN 2023-09-16 16:01:53,198 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b46fb815fcab164f6332e8bbe5d6e1e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35809,1694880071932; forceNewPlan=false, retain=false 2023-09-16 16:01:53,198 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07b2aef2597a17481b97a27e878413ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45159,1694880071982; forceNewPlan=false, retain=false 2023-09-16 16:01:53,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-16 16:01:53,348 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-16 16:01:53,351 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=07b2aef2597a17481b97a27e878413ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,351 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b46fb815fcab164f6332e8bbe5d6e1e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,351 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880113351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880113351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880113351"}]},"ts":"1694880113351"} 2023-09-16 16:01:53,351 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880113351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880113351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880113351"}]},"ts":"1694880113351"} 2023-09-16 16:01:53,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 07b2aef2597a17481b97a27e878413ca, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:01:53,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure b46fb815fcab164f6332e8bbe5d6e1e9, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:01:53,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-16 16:01:53,508 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,508 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-16 16:01:53,512 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-16 16:01:53,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07b2aef2597a17481b97a27e878413ca, NAME => 'testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.', STARTKEY => '1', ENDKEY => ''} 2023-09-16 16:01:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. service=AccessControlService 2023-09-16 16:01:53,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:53,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,516 INFO [StoreOpener-07b2aef2597a17481b97a27e878413ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b46fb815fcab164f6332e8bbe5d6e1e9, NAME => 'testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.', STARTKEY => '', ENDKEY => '1'} 2023-09-16 16:01:53,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. service=AccessControlService 2023-09-16 16:01:53,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:01:53,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:01:53,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,517 DEBUG [StoreOpener-07b2aef2597a17481b97a27e878413ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf 2023-09-16 16:01:53,518 DEBUG [StoreOpener-07b2aef2597a17481b97a27e878413ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf 2023-09-16 16:01:53,518 INFO [StoreOpener-b46fb815fcab164f6332e8bbe5d6e1e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,518 INFO [StoreOpener-07b2aef2597a17481b97a27e878413ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b2aef2597a17481b97a27e878413ca columnFamilyName cf 2023-09-16 16:01:53,519 DEBUG [StoreOpener-b46fb815fcab164f6332e8bbe5d6e1e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf 2023-09-16 16:01:53,519 DEBUG [StoreOpener-b46fb815fcab164f6332e8bbe5d6e1e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf 2023-09-16 16:01:53,519 INFO [StoreOpener-07b2aef2597a17481b97a27e878413ca-1] regionserver.HStore(310): Store=07b2aef2597a17481b97a27e878413ca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:53,520 INFO [StoreOpener-b46fb815fcab164f6332e8bbe5d6e1e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b46fb815fcab164f6332e8bbe5d6e1e9 columnFamilyName cf 2023-09-16 16:01:53,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,520 INFO [StoreOpener-b46fb815fcab164f6332e8bbe5d6e1e9-1] regionserver.HStore(310): Store=b46fb815fcab164f6332e8bbe5d6e1e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:01:53,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07b2aef2597a17481b97a27e878413ca 2023-09-16 16:01:53,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:01:53,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:53,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07b2aef2597a17481b97a27e878413ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70453891, jitterRate=0.049844786524772644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:53,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07b2aef2597a17481b97a27e878413ca: 2023-09-16 16:01:53,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca., pid=45, masterSystemTime=1694880113505 2023-09-16 16:01:53,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:01:53,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b46fb815fcab164f6332e8bbe5d6e1e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72983093, jitterRate=0.08753283321857452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:01:53,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b46fb815fcab164f6332e8bbe5d6e1e9: 2023-09-16 16:01:53,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9., pid=46, masterSystemTime=1694880113508 2023-09-16 16:01:53,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=07b2aef2597a17481b97a27e878413ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,533 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880113533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880113533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880113533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880113533"}]},"ts":"1694880113533"} 2023-09-16 16:01:53,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,535 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b46fb815fcab164f6332e8bbe5d6e1e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,535 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880113535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880113535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880113535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880113535"}]},"ts":"1694880113535"} 2023-09-16 16:01:53,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-16 16:01:53,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 07b2aef2597a17481b97a27e878413ca, server=jenkins-hbase4.apache.org,45159,1694880071982 in 183 msec 2023-09-16 16:01:53,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-16 16:01:53,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure b46fb815fcab164f6332e8bbe5d6e1e9, server=jenkins-hbase4.apache.org,35809,1694880071932 in 183 msec 2023-09-16 16:01:53,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07b2aef2597a17481b97a27e878413ca, ASSIGN in 346 msec 2023-09-16 16:01:53,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-16 16:01:53,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b46fb815fcab164f6332e8bbe5d6e1e9, ASSIGN in 347 msec 2023-09-16 16:01:53,542 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:01:53,542 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880113542"}]},"ts":"1694880113542"} 2023-09-16 16:01:53,544 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-16 16:01:53,546 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:01:53,546 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-16 16:01:53,548 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-16 16:01:53,550 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:53,550 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:53,550 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:53,550 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:01:53,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:53,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:53,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:53,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-16 16:01:53,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 409 msec 2023-09-16 16:01:53,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-16 16:01:53,752 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-16 16:01:53,755 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-16 16:01:53,755 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,757 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:01:53,765 DEBUG [hconnection-0x1eb93e1b-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:53,770 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:53,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-16 16:01:53,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880113775 (current time:1694880113775). 2023-09-16 16:01:53,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:01:53,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x3aaf143c to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:53,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f4ff1b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:53,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:53,789 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:53,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aaf143c to 127.0.0.1:61309 2023-09-16 16:01:53,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:53,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x49611c92 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b2def76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:53,803 DEBUG [hconnection-0x2bcf7df6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:53,805 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:53,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:53,811 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:53,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49611c92 to 127.0.0.1:61309 2023-09-16 16:01:53,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:53,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-16 16:01:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:01:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-16 16:01:53,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-16 16:01:53,819 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-16 16:01:53,820 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694880713820 2023-09-16 16:01:53,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-16 16:01:53,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-16 16:01:53,821 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:01:53,822 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:01:53,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-16 16:01:53,823 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-16 16:01:53,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-16 16:01:53,825 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-16 16:01:53,826 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694880713826 2023-09-16 16:01:53,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,841 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-16 16:01:53,841 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:53,843 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-16 16:01:53,843 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-16 16:01:53,843 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,843 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,844 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:53,844 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:53,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:53,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:53,844 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:53,844 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,845 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,845 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,846 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,846 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,847 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-16 16:01:53,846 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-16 16:01:53,847 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:53,847 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:53,847 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-16 16:01:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-16 16:01:53,848 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-16 16:01:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-16 16:01:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-16 16:01:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-16 16:01:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-16 16:01:53,852 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-16 16:01:53,852 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-16 16:01:53,852 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-16 16:01:53,854 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,854 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,854 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:53,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:53,858 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:53,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-16 16:01:53,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@693fa7dd[Count = 1] remaining members to acquire global barrier 2023-09-16 16:01:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:53,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-16 16:01:53,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@693fa7dd[Count = 0] remaining members to acquire global barrier 2023-09-16 16:01:53,862 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-16 16:01:53,862 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,863 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,863 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,863 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-16 16:01:53,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-16 16:01:53,864 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:01:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-16 16:01:53,864 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,864 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:53,864 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,864 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,865 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. started... 2023-09-16 16:01:53,865 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. started... 2023-09-16 16:01:53,864 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:53,865 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:53,866 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b46fb815fcab164f6332e8bbe5d6e1e9: 2023-09-16 16:01:53,866 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07b2aef2597a17481b97a27e878413ca: 2023-09-16 16:01:53,866 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,866 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:53,866 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,866 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:01:53,867 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:53,867 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:01:53,871 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-16 16:01:53,871 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:53,872 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-16 16:01:53,877 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. completed. 2023-09-16 16:01:53,877 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:53,877 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. completed. 2023-09-16 16:01:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:53,877 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-16 16:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-16 16:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:01:53,879 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,879 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-16 16:01:53,879 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,879 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-16 16:01:53,879 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:53,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,879 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-16 16:01:53,879 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:53,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:53,880 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-16 16:01:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-16 16:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:01:53,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-16 16:01:53,888 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-16 16:01:53,888 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:01:53,888 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:01:53,888 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,888 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:01:53,889 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,889 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,889 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:53,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:53,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,890 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:53,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:53,890 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,891 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:53,892 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:53,895 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,895 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,895 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,898 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,898 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,898 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:53,898 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:53,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:53,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:53,898 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:53,899 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:53,899 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:53,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:53,899 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:53,898 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:53,898 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:53,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:53,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:53,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:53,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:53,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-16 16:01:53,900 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,901 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:53,901 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:53,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:53,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:53,901 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:01:53,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:53,901 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:53,901 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:53,901 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,901 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-16 16:01:53,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,922 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:53,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-16 16:01:53,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:53,923 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:01:53,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-16 16:01:53,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,926 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-16 16:01:53,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694880113820Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694880113909 (+89 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694880113909Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694880113909Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694880113912 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694880113920 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694880113926 (+6 ms) 2023-09-16 16:01:53,929 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-16 16:01:53,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 108 msec 2023-09-16 16:01:54,123 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:54,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-16 16:01:54,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:01:54,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35809] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:01:54,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45159] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:01:54,132 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-16 16:01:54,132 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:54,132 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:01:54,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-16 16:01:54,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880114143 (current time:1694880114143). 2023-09-16 16:01:54,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:01:54,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x1b0addf1 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:54,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@292b000e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:54,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:54,159 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:54,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b0addf1 to 127.0.0.1:61309 2023-09-16 16:01:54,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:54,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x7e7db7d0 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:01:54,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@335508bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:01:54,172 DEBUG [hconnection-0x428f45af-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:54,175 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:54,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:01:54,179 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:01:54,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e7db7d0 to 127.0.0.1:61309 2023-09-16 16:01:54,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:01:54,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-16 16:01:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:01:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-16 16:01:54,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-16 16:01:54,185 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-16 16:01:54,186 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694880714186 2023-09-16 16:01:54,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-16 16:01:54,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-16 16:01:54,187 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:01:54,187 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:01:54,188 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-16 16:01:54,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-16 16:01:54,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-16 16:01:54,190 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-16 16:01:54,191 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694880714191 2023-09-16 16:01:54,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-16 16:01:54,206 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-16 16:01:54,206 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:54,207 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-16 16:01:54,207 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-16 16:01:54,208 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,208 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,210 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:54,210 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:54,210 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:54,210 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:54,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:54,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,210 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,210 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,211 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,211 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-16 16:01:54,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-16 16:01:54,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-16 16:01:54,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-16 16:01:54,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-16 16:01:54,212 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-16 16:01:54,212 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-16 16:01:54,212 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:54,212 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:54,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-16 16:01:54,215 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-16 16:01:54,215 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-16 16:01:54,215 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-16 16:01:54,213 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-16 16:01:54,215 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-16 16:01:54,215 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:01:54,215 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-16 16:01:54,216 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-16 16:01:54,216 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-16 16:01:54,216 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-16 16:01:54,216 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-16 16:01:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,218 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,218 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,219 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:54,219 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,219 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:54,219 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,219 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:01:54,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:54,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:54,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:54,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:54,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:54,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-16 16:01:54,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70a74da6[Count = 1] remaining members to acquire global barrier 2023-09-16 16:01:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:54,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-16 16:01:54,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70a74da6[Count = 0] remaining members to acquire global barrier 2023-09-16 16:01:54,228 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-16 16:01:54,228 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,229 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,229 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-16 16:01:54,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-16 16:01:54,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-16 16:01:54,230 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,230 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:54,230 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:54,230 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:01:54,230 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:54,230 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. started... 2023-09-16 16:01:54,230 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. started... 2023-09-16 16:01:54,230 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b46fb815fcab164f6332e8bbe5d6e1e9 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-16 16:01:54,231 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 07b2aef2597a17481b97a27e878413ca 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-16 16:01:54,232 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-16 16:01:54,232 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:54,232 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-16 16:01:54,257 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091609cdad571e0c4d8b981e0849c406ce05 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091609cdad571e0c4d8b981e0849c406ce05 2023-09-16 16:01:54,257 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230916ffd8dbf201c941c4921a96b70ff0c78f to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230916ffd8dbf201c941c4921a96b70ff0c78f 2023-09-16 16:01:54,269 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/.tmp/cf/1c061f9f93e843db84f90a98cf8db162 2023-09-16 16:01:54,272 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/.tmp/cf/13164769248a4bbba3afddd484e743fd 2023-09-16 16:01:54,275 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/.tmp/cf/1c061f9f93e843db84f90a98cf8db162 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf/1c061f9f93e843db84f90a98cf8db162 2023-09-16 16:01:54,277 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/.tmp/cf/13164769248a4bbba3afddd484e743fd as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf/13164769248a4bbba3afddd484e743fd 2023-09-16 16:01:54,280 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf/1c061f9f93e843db84f90a98cf8db162, entries=47, sequenceid=6, filesize=12.7 K 2023-09-16 16:01:54,281 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 07b2aef2597a17481b97a27e878413ca in 51ms, sequenceid=6, compaction requested=false 2023-09-16 16:01:54,281 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-16 16:01:54,281 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf/13164769248a4bbba3afddd484e743fd, entries=3, sequenceid=6, filesize=5.4 K 2023-09-16 16:01:54,282 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07b2aef2597a17481b97a27e878413ca: 2023-09-16 16:01:54,282 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b46fb815fcab164f6332e8bbe5d6e1e9 in 52ms, sequenceid=6, compaction requested=false 2023-09-16 16:01:54,283 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b46fb815fcab164f6332e8bbe5d6e1e9: 2023-09-16 16:01:54,283 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-16 16:01:54,284 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:54,284 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-16 16:01:54,284 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf/1c061f9f93e843db84f90a98cf8db162] hfiles 2023-09-16 16:01:54,284 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:01:54,284 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf/1c061f9f93e843db84f90a98cf8db162 for snapshot=snaptb0-testConsecutiveExports 2023-09-16 16:01:54,284 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf/13164769248a4bbba3afddd484e743fd] hfiles 2023-09-16 16:01:54,284 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf/13164769248a4bbba3afddd484e743fd for snapshot=snaptb0-testConsecutiveExports 2023-09-16 16:01:54,287 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:54,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-16 16:01:54,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:01:54,289 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:01:54,291 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. completed. 2023-09-16 16:01:54,291 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:01:54,291 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:01:54,292 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. completed. 2023-09-16 16:01:54,292 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-16 16:01:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:01:54,294 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-16 16:01:54,294 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,294 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:54,294 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-16 16:01:54,296 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,296 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-16 16:01:54,296 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:54,296 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-16 16:01:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:01:54,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-16 16:01:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:01:54,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-16 16:01:54,304 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-16 16:01:54,304 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:01:54,304 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:01:54,304 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-16 16:01:54,304 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:01:54,305 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,305 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:01:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:01:54,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,305 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:54,305 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,305 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:54,306 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,306 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:54,306 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:01:54,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:54,306 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:54,307 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:01:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,309 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:01:54,309 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-16 16:01:54,309 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,316 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,316 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:54,316 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:54,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:54,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:54,316 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:54,316 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:01:54,316 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-16 16:01:54,316 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-16 16:01:54,316 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:54,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:54,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:54,316 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:01:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:54,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-16 16:01:54,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:01:54,318 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:54,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:01:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:01:54,318 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,319 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091609cdad571e0c4d8b981e0849c406ce05, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230916ffd8dbf201c941c4921a96b70ff0c78f] mob files 2023-09-16 16:01:54,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:01:54,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:01:54,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091609cdad571e0c4d8b981e0849c406ce05 2023-09-16 16:01:54,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230916ffd8dbf201c941c4921a96b70ff0c78f 2023-09-16 16:01:54,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-16 16:01:54,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,348 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-16 16:01:54,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,348 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694880114186Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694880114327 (+141 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694880114327Loading Region manifests for snaptb0-testConsecutiveExports at 1694880114327Writing data manifest for snaptb0-testConsecutiveExports at 1694880114331 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694880114341 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694880114348 (+7 ms) 2023-09-16 16:01:54,351 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-16 16:01:54,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 164 msec 2023-09-16 16:01:54,489 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:01:54,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-16 16:01:54,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:01:54,491 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490 2023-09-16 16:01:54,491 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490, srcFsUri=hdfs://localhost:42433, srcDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:54,513 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:01:54,513 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6f76fa7e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,513 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, snapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-16 16:01:54,522 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-16 16:01:54,535 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:54,535 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:54,535 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:54,536 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,429 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-4992034718418694112.jar 2023-09-16 16:01:55,430 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,430 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,496 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-1986484180517703734.jar 2023-09-16 16:01:55,497 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,497 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,498 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,498 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,498 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,499 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-16 16:01:55,499 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-16 16:01:55,500 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-16 16:01:55,500 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-16 16:01:55,500 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-16 16:01:55,501 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-16 16:01:55,501 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-16 16:01:55,502 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-16 16:01:55,502 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-16 16:01:55,502 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-16 16:01:55,503 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-16 16:01:55,503 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:55,504 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:55,504 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:55,504 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:55,505 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:01:55,505 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:55,506 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:01:55,880 WARN [Listener at jenkins-hbase4.apache.org/42447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-16 16:01:55,882 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-16 16:01:55,885 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-16 16:01:57,154 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:01:57,154 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:01:57,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0002_000001 (auth:SIMPLE) 2023-09-16 16:01:57,956 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0003_000001 (auth:SIMPLE) 2023-09-16 16:01:58,417 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:02:01,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0003_000001 (auth:SIMPLE) 2023-09-16 16:02:03,933 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0003_000001 (auth:SIMPLE) 2023-09-16 16:02:06,242 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0003_000001 (auth:SIMPLE) 2023-09-16 16:02:08,038 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-16 16:02:08,038 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-16 16:02:08,042 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-16 16:02:08,043 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-16 16:02:08,043 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-16 16:02:08,043 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-16 16:02:08,046 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-16 16:02:08,046 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-16 16:02:08,047 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@936b0e9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-16 16:02:08,047 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-16 16:02:08,047 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-16 16:02:08,048 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490, srcFsUri=hdfs://localhost:42433, srcDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:08,070 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:08,070 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1b87cb85, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-16 16:02:08,070 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, snapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-16 16:02:08,081 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-16 16:02:08,092 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:08,093 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:08,093 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:08,094 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:08,984 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-2892513735769539856.jar 2023-09-16 16:02:08,984 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:08,985 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:09,051 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-7989916563204354637.jar 2023-09-16 16:02:09,051 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:09,052 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:09,052 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:09,052 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:09,053 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:09,053 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:09,053 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-16 16:02:09,054 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-16 16:02:09,054 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-16 16:02:09,055 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-16 16:02:09,055 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-16 16:02:09,055 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-16 16:02:09,056 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-16 16:02:09,056 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-16 16:02:09,056 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-16 16:02:09,057 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-16 16:02:09,057 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:09,058 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:09,058 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:09,059 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:09,059 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:09,059 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:09,060 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:09,424 WARN [Listener at jenkins-hbase4.apache.org/42447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-16 16:02:09,427 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-16 16:02:09,429 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-16 16:02:12,412 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:12,412 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:12,414 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0003_000001 (auth:SIMPLE) 2023-09-16 16:02:13,167 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0004_000001 (auth:SIMPLE) 2023-09-16 16:02:16,870 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0004_000001 (auth:SIMPLE) 2023-09-16 16:02:19,086 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0004_000001 (auth:SIMPLE) 2023-09-16 16:02:21,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0004_000001 (auth:SIMPLE) 2023-09-16 16:02:22,590 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-16 16:02:22,590 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-16 16:02:22,593 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-16 16:02:22,593 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-16 16:02:22,593 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-16 16:02:22,593 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-16 16:02:22,596 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-16 16:02:22,596 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-16 16:02:22,596 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@936b0e9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-16 16:02:22,597 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-16 16:02:22,597 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/local-export-1694880114490/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-16 16:02:22,609 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-16 16:02:22,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-16 16:02:22,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:02:22,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-16 16:02:22,614 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880142614"}]},"ts":"1694880142614"} 2023-09-16 16:02:22,616 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-16 16:02:22,617 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-16 16:02:22,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b46fb815fcab164f6332e8bbe5d6e1e9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07b2aef2597a17481b97a27e878413ca, UNASSIGN}] 2023-09-16 16:02:22,620 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b46fb815fcab164f6332e8bbe5d6e1e9, UNASSIGN 2023-09-16 16:02:22,620 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07b2aef2597a17481b97a27e878413ca, UNASSIGN 2023-09-16 16:02:22,621 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b46fb815fcab164f6332e8bbe5d6e1e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:22,621 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880142621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880142621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880142621"}]},"ts":"1694880142621"} 2023-09-16 16:02:22,621 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=07b2aef2597a17481b97a27e878413ca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:22,621 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880142621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880142621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880142621"}]},"ts":"1694880142621"} 2023-09-16 16:02:22,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure b46fb815fcab164f6332e8bbe5d6e1e9, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:02:22,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 07b2aef2597a17481b97a27e878413ca, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:22,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-16 16:02:22,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 07b2aef2597a17481b97a27e878413ca 2023-09-16 16:02:22,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07b2aef2597a17481b97a27e878413ca, disabling compactions & flushes 2023-09-16 16:02:22,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:02:22,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:02:22,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b46fb815fcab164f6332e8bbe5d6e1e9, disabling compactions & flushes 2023-09-16 16:02:22,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:02:22,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:02:22,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. after waiting 0 ms 2023-09-16 16:02:22,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:02:22,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:02:22,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. after waiting 0 ms 2023-09-16 16:02:22,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:02:22,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:02:22,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:02:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:22,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9. 2023-09-16 16:02:22,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca. 2023-09-16 16:02:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b46fb815fcab164f6332e8bbe5d6e1e9: 2023-09-16 16:02:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07b2aef2597a17481b97a27e878413ca: 2023-09-16 16:02:22,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 07b2aef2597a17481b97a27e878413ca 2023-09-16 16:02:22,788 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=07b2aef2597a17481b97a27e878413ca, regionState=CLOSED 2023-09-16 16:02:22,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:02:22,788 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880142788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880142788"}]},"ts":"1694880142788"} 2023-09-16 16:02:22,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b46fb815fcab164f6332e8bbe5d6e1e9, regionState=CLOSED 2023-09-16 16:02:22,789 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694880142789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880142789"}]},"ts":"1694880142789"} 2023-09-16 16:02:22,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-16 16:02:22,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 07b2aef2597a17481b97a27e878413ca, server=jenkins-hbase4.apache.org,45159,1694880071982 in 167 msec 2023-09-16 16:02:22,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-16 16:02:22,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure b46fb815fcab164f6332e8bbe5d6e1e9, server=jenkins-hbase4.apache.org,35809,1694880071932 in 168 msec 2023-09-16 16:02:22,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07b2aef2597a17481b97a27e878413ca, UNASSIGN in 173 msec 2023-09-16 16:02:22,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-16 16:02:22,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b46fb815fcab164f6332e8bbe5d6e1e9, UNASSIGN in 174 msec 2023-09-16 16:02:22,794 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880142794"}]},"ts":"1694880142794"} 2023-09-16 16:02:22,795 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-16 16:02:22,797 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-16 16:02:22,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 188 msec 2023-09-16 16:02:22,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-16 16:02:22,916 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-16 16:02:22,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-16 16:02:22,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:02:22,920 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:02:22,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-16 16:02:22,921 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:02:22,923 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-16 16:02:22,926 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,926 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,926 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,926 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-16 16:02:22,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-16 16:02:22,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-16 16:02:22,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-16 16:02:22,927 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:02:22,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:22,929 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:22,929 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/recovered.edits] 2023-09-16 16:02:22,930 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/recovered.edits] 2023-09-16 16:02:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-16 16:02:22,934 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf/13164769248a4bbba3afddd484e743fd to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/cf/13164769248a4bbba3afddd484e743fd 2023-09-16 16:02:22,935 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf/1c061f9f93e843db84f90a98cf8db162 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/cf/1c061f9f93e843db84f90a98cf8db162 2023-09-16 16:02:22,938 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9/recovered.edits/9.seqid 2023-09-16 16:02:22,938 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca/recovered.edits/9.seqid 2023-09-16 16:02:22,939 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/b46fb815fcab164f6332e8bbe5d6e1e9 2023-09-16 16:02:22,939 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testConsecutiveExports/07b2aef2597a17481b97a27e878413ca 2023-09-16 16:02:22,939 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-16 16:02:22,940 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-16 16:02:22,940 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-16 16:02:22,944 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091609cdad571e0c4d8b981e0849c406ce05 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091609cdad571e0c4d8b981e0849c406ce05 2023-09-16 16:02:22,945 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230916ffd8dbf201c941c4921a96b70ff0c78f to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230916ffd8dbf201c941c4921a96b70ff0c78f 2023-09-16 16:02:22,946 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-16 16:02:22,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:02:22,950 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-16 16:02:22,952 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-16 16:02:22,953 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:02:22,953 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-16 16:02:22,953 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880142953"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:22,954 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880142953"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:22,955 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-16 16:02:22,955 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b46fb815fcab164f6332e8bbe5d6e1e9, NAME => 'testtb-testConsecutiveExports,,1694880113143.b46fb815fcab164f6332e8bbe5d6e1e9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 07b2aef2597a17481b97a27e878413ca, NAME => 'testtb-testConsecutiveExports,1,1694880113143.07b2aef2597a17481b97a27e878413ca.', STARTKEY => '1', ENDKEY => ''}] 2023-09-16 16:02:22,955 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-16 16:02:22,955 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694880142955"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:22,957 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-16 16:02:22,960 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-16 16:02:22,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 43 msec 2023-09-16 16:02:23,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-16 16:02:23,031 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-16 16:02:23,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-16 16:02:23,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-16 16:02:23,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-16 16:02:23,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-16 16:02:23,070 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=752 (was 763), OpenFileDescriptor=907 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 252), ProcessCount=168 (was 168), AvailableMemoryMB=7179 (was 7280) 2023-09-16 16:02:23,070 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-16 16:02:23,088 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=752, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=168, AvailableMemoryMB=7178 2023-09-16 16:02:23,088 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-16 16:02:23,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-16 16:02:23,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,093 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:02:23,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-16 16:02:23,094 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:02:23,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-16 16:02:23,096 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,096 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,097 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a empty. 2023-09-16 16:02:23,097 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204 empty. 2023-09-16 16:02:23,097 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,097 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,098 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-16 16:02:23,107 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-16 16:02:23,108 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => bc49bf66056897645084b6137762027a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:23,109 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 08fe3478eef60f40d302665bf000a204, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:23,118 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:23,118 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 08fe3478eef60f40d302665bf000a204, disabling compactions & flushes 2023-09-16 16:02:23,118 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,118 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,118 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. after waiting 0 ms 2023-09-16 16:02:23,118 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,118 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,118 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 08fe3478eef60f40d302665bf000a204: 2023-09-16 16:02:23,119 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:23,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing bc49bf66056897645084b6137762027a, disabling compactions & flushes 2023-09-16 16:02:23,120 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. after waiting 0 ms 2023-09-16 16:02:23,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,120 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for bc49bf66056897645084b6137762027a: 2023-09-16 16:02:23,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:02:23,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880143123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880143123"}]},"ts":"1694880143123"} 2023-09-16 16:02:23,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880143123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880143123"}]},"ts":"1694880143123"} 2023-09-16 16:02:23,129 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-16 16:02:23,130 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:02:23,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880143130"}]},"ts":"1694880143130"} 2023-09-16 16:02:23,131 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-16 16:02:23,134 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:02:23,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:02:23,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:02:23,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:02:23,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:02:23,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc49bf66056897645084b6137762027a, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fe3478eef60f40d302665bf000a204, ASSIGN}] 2023-09-16 16:02:23,138 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fe3478eef60f40d302665bf000a204, ASSIGN 2023-09-16 16:02:23,138 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc49bf66056897645084b6137762027a, ASSIGN 2023-09-16 16:02:23,139 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fe3478eef60f40d302665bf000a204, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35809,1694880071932; forceNewPlan=false, retain=false 2023-09-16 16:02:23,139 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc49bf66056897645084b6137762027a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1694880072020; forceNewPlan=false, retain=false 2023-09-16 16:02:23,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-16 16:02:23,289 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-16 16:02:23,291 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bc49bf66056897645084b6137762027a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,291 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=08fe3478eef60f40d302665bf000a204, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880143291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880143291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880143291"}]},"ts":"1694880143291"} 2023-09-16 16:02:23,292 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880143291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880143291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880143291"}]},"ts":"1694880143291"} 2023-09-16 16:02:23,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure bc49bf66056897645084b6137762027a, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:02:23,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 08fe3478eef60f40d302665bf000a204, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:02:23,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-16 16:02:23,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bc49bf66056897645084b6137762027a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.', STARTKEY => '', ENDKEY => '1'} 2023-09-16 16:02:23,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. service=AccessControlService 2023-09-16 16:02:23,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08fe3478eef60f40d302665bf000a204, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.', STARTKEY => '1', ENDKEY => ''} 2023-09-16 16:02:23,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. service=AccessControlService 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:23,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,452 INFO [StoreOpener-bc49bf66056897645084b6137762027a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,452 INFO [StoreOpener-08fe3478eef60f40d302665bf000a204-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,454 DEBUG [StoreOpener-bc49bf66056897645084b6137762027a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf 2023-09-16 16:02:23,454 DEBUG [StoreOpener-08fe3478eef60f40d302665bf000a204-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf 2023-09-16 16:02:23,454 DEBUG [StoreOpener-08fe3478eef60f40d302665bf000a204-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf 2023-09-16 16:02:23,454 DEBUG [StoreOpener-bc49bf66056897645084b6137762027a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf 2023-09-16 16:02:23,455 INFO [StoreOpener-08fe3478eef60f40d302665bf000a204-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08fe3478eef60f40d302665bf000a204 columnFamilyName cf 2023-09-16 16:02:23,455 INFO [StoreOpener-bc49bf66056897645084b6137762027a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc49bf66056897645084b6137762027a columnFamilyName cf 2023-09-16 16:02:23,456 INFO [StoreOpener-08fe3478eef60f40d302665bf000a204-1] regionserver.HStore(310): Store=08fe3478eef60f40d302665bf000a204/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:23,456 INFO [StoreOpener-bc49bf66056897645084b6137762027a-1] regionserver.HStore(310): Store=bc49bf66056897645084b6137762027a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:23,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:23,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bc49bf66056897645084b6137762027a 2023-09-16 16:02:23,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:23,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:23,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 08fe3478eef60f40d302665bf000a204; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59324618, jitterRate=-0.11599430441856384}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:23,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 08fe3478eef60f40d302665bf000a204: 2023-09-16 16:02:23,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bc49bf66056897645084b6137762027a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71908431, jitterRate=0.07151912152767181}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:23,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bc49bf66056897645084b6137762027a: 2023-09-16 16:02:23,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204., pid=61, masterSystemTime=1694880143446 2023-09-16 16:02:23,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a., pid=60, masterSystemTime=1694880143445 2023-09-16 16:02:23,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,466 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=08fe3478eef60f40d302665bf000a204, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,467 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880143466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880143466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880143466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880143466"}]},"ts":"1694880143466"} 2023-09-16 16:02:23,467 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bc49bf66056897645084b6137762027a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,467 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880143467"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880143467"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880143467"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880143467"}]},"ts":"1694880143467"} 2023-09-16 16:02:23,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-16 16:02:23,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 08fe3478eef60f40d302665bf000a204, server=jenkins-hbase4.apache.org,35809,1694880071932 in 174 msec 2023-09-16 16:02:23,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-16 16:02:23,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure bc49bf66056897645084b6137762027a, server=jenkins-hbase4.apache.org,42403,1694880072020 in 176 msec 2023-09-16 16:02:23,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fe3478eef60f40d302665bf000a204, ASSIGN in 336 msec 2023-09-16 16:02:23,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-16 16:02:23,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc49bf66056897645084b6137762027a, ASSIGN in 337 msec 2023-09-16 16:02:23,474 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:02:23,474 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880143474"}]},"ts":"1694880143474"} 2023-09-16 16:02:23,475 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-16 16:02:23,478 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:02:23,478 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-16 16:02:23,480 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-16 16:02:23,483 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:23,483 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:23,483 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:23,483 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:23,485 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:23,485 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:23,485 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:23,485 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:23,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 395 msec 2023-09-16 16:02:23,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-16 16:02:23,697 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-16 16:02:23,699 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,699 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,701 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:02:23,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-16 16:02:23,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880143712 (current time:1694880143712). 2023-09-16 16:02:23,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:02:23,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x0fa5762e to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:23,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b5dbc34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:23,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:23,722 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:23,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fa5762e to 127.0.0.1:61309 2023-09-16 16:02:23,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:23,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x3efb2e0c to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:23,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a4b3bfb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:23,731 DEBUG [hconnection-0x2cc1889a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:23,732 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:23,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:23,738 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3efb2e0c to 127.0.0.1:61309 2023-09-16 16:02:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-16 16:02:23,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:02:23,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-16 16:02:23,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-16 16:02:23,745 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-16 16:02:23,746 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694880743746 2023-09-16 16:02:23,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-16 16:02:23,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,747 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:02:23,747 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:02:23,748 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-16 16:02:23,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-16 16:02:23,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-16 16:02:23,750 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-16 16:02:23,750 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694880743750 2023-09-16 16:02:23,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,760 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-16 16:02:23,760 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,761 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-16 16:02:23,761 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-16 16:02:23,761 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,761 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,763 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,763 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,763 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,763 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,763 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,763 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,764 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,764 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-16 16:02:23,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-16 16:02:23,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-16 16:02:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-16 16:02:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-16 16:02:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,767 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-16 16:02:23,767 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-16 16:02:23,767 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-16 16:02:23,767 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-16 16:02:23,767 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-16 16:02:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-16 16:02:23,768 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-16 16:02:23,768 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-16 16:02:23,767 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-16 16:02:23,769 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,769 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,771 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,771 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:23,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@645fa93b[Count = 1] remaining members to acquire global barrier 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-16 16:02:23,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@645fa93b[Count = 0] remaining members to acquire global barrier 2023-09-16 16:02:23,775 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-16 16:02:23,775 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-16 16:02:23,776 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,776 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-16 16:02:23,776 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:23,777 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:23,776 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-16 16:02:23,777 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,777 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:02:23,777 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:02:23,776 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-16 16:02:23,777 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,777 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. started... 2023-09-16 16:02:23,777 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:23,777 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:23,777 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,777 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. started... 2023-09-16 16:02:23,777 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc49bf66056897645084b6137762027a: 2023-09-16 16:02:23,778 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08fe3478eef60f40d302665bf000a204: 2023-09-16 16:02:23,778 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,778 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:23,778 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,778 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:02:23,778 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:23,778 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:02:23,785 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-16 16:02:23,785 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,785 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-16 16:02:23,789 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. completed. 2023-09-16 16:02:23,789 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,789 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:23,789 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:23,789 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. completed. 2023-09-16 16:02:23,790 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,789 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,790 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:23,790 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:23,790 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,790 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-16 16:02:23,790 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-16 16:02:23,790 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:02:23,790 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:02:23,791 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-16 16:02:23,791 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,791 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,791 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-16 16:02:23,791 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-16 16:02:23,791 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,792 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,793 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-16 16:02:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42403,1694880072020': 2023-09-16 16:02:23,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-16 16:02:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:02:23,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-16 16:02:23,800 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-16 16:02:23,800 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:02:23,800 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:02:23,800 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,800 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:02:23,801 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,801 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,801 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,801 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,802 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,802 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,803 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,804 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,805 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,805 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,806 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,809 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,811 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,811 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,809 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,811 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:02:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,811 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,811 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,812 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-16 16:02:23,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-16 16:02:23,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,840 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694880143746Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694880143821 (+75 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694880143821Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694880143821Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694880143826 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694880143834 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694880143839 (+5 ms) 2023-09-16 16:02:23,842 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-16 16:02:23,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 95 msec 2023-09-16 16:02:23,847 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:23,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-16 16:02:23,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:02:23,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:02:23,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:02:23,854 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,854 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,854 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:02:23,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-16 16:02:23,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880143864 (current time:1694880143864). 2023-09-16 16:02:23,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:02:23,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x00476725 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:23,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c505c81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:23,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:23,875 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:23,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00476725 to 127.0.0.1:61309 2023-09-16 16:02:23,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:23,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x3424c2de to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:23,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fe1f530, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:23,884 DEBUG [hconnection-0x419b0419-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:23,887 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:23,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:23,892 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:23,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3424c2de to 127.0.0.1:61309 2023-09-16 16:02:23,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:23,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-16 16:02:23,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:02:23,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-16 16:02:23,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-16 16:02:23,897 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-16 16:02:23,898 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694880743898 2023-09-16 16:02:23,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-16 16:02:23,899 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:02:23,899 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:02:23,900 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-16 16:02:23,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-16 16:02:23,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-16 16:02:23,902 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-16 16:02:23,903 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694880743903 2023-09-16 16:02:23,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,911 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-16 16:02:23,911 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,912 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-16 16:02:23,912 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-16 16:02:23,913 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,913 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,914 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,914 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,914 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,914 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,915 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,915 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,916 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-16 16:02:23,916 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,916 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,916 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-16 16:02:23,917 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-16 16:02:23,917 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-16 16:02:23,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,917 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-16 16:02:23,918 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-16 16:02:23,918 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,917 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:23,918 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-16 16:02:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-16 16:02:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-16 16:02:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-16 16:02:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-16 16:02:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-16 16:02:23,920 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,920 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,922 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,922 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-16 16:02:23,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61d573b9[Count = 1] remaining members to acquire global barrier 2023-09-16 16:02:23,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-16 16:02:23,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61d573b9[Count = 0] remaining members to acquire global barrier 2023-09-16 16:02:23,926 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-16 16:02:23,926 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-16 16:02:23,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,928 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:02:23,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,929 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,929 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,929 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-16 16:02:23,929 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. started... 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:23,929 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:23,929 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,929 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. started... 2023-09-16 16:02:23,929 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bc49bf66056897645084b6137762027a 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-16 16:02:23,930 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 08fe3478eef60f40d302665bf000a204 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-16 16:02:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-16 16:02:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-16 16:02:23,946 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309167f67e64af6ec48cfb600ff7cbe41c808 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309167f67e64af6ec48cfb600ff7cbe41c808 2023-09-16 16:02:23,948 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091673218b8f8f894ba8a0c30310c5e7e589 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091673218b8f8f894ba8a0c30310c5e7e589 2023-09-16 16:02:23,954 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/.tmp/cf/1aaee1b8ce774534a7a511c5aae7a10f 2023-09-16 16:02:23,956 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/.tmp/cf/3caa10a0cf864a7bba0dd2394cbe6285 2023-09-16 16:02:23,959 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/.tmp/cf/1aaee1b8ce774534a7a511c5aae7a10f as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf/1aaee1b8ce774534a7a511c5aae7a10f 2023-09-16 16:02:23,961 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/.tmp/cf/3caa10a0cf864a7bba0dd2394cbe6285 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf/3caa10a0cf864a7bba0dd2394cbe6285 2023-09-16 16:02:23,963 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf/1aaee1b8ce774534a7a511c5aae7a10f, entries=6, sequenceid=6, filesize=6.0 K 2023-09-16 16:02:23,964 INFO [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for bc49bf66056897645084b6137762027a in 35ms, sequenceid=6, compaction requested=false 2023-09-16 16:02:23,964 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-16 16:02:23,965 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc49bf66056897645084b6137762027a: 2023-09-16 16:02:23,965 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,965 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf/3caa10a0cf864a7bba0dd2394cbe6285, entries=44, sequenceid=6, filesize=13.0 K 2023-09-16 16:02:23,965 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:23,965 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf/1aaee1b8ce774534a7a511c5aae7a10f] hfiles 2023-09-16 16:02:23,965 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf/1aaee1b8ce774534a7a511c5aae7a10f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,966 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 08fe3478eef60f40d302665bf000a204 in 37ms, sequenceid=6, compaction requested=false 2023-09-16 16:02:23,967 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08fe3478eef60f40d302665bf000a204: 2023-09-16 16:02:23,967 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,967 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:23,967 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf/3caa10a0cf864a7bba0dd2394cbe6285] hfiles 2023-09-16 16:02:23,967 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf/3caa10a0cf864a7bba0dd2394cbe6285 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,974 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. completed. 2023-09-16 16:02:23,974 DEBUG [rs(jenkins-hbase4.apache.org,42403,1694880072020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:23,974 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. completed. 2023-09-16 16:02:23,974 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-16 16:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-16 16:02:23,975 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:02:23,975 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:02:23,976 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-16 16:02:23,976 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-16 16:02:23,976 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,977 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,976 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,977 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-16 16:02:23,977 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,978 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-16 16:02:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42403,1694880072020': 2023-09-16 16:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-16 16:02:23,986 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-16 16:02:23,986 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:02:23,986 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:02:23,986 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,986 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:02:23,992 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,992 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,992 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:23,992 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:23,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,993 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:23,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:23,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,993 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:23,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,995 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:23,995 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,995 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:23,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:23,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,998 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:24,000 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:23,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:23,998 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,000 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:24,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:02:24,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:24,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:24,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:24,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:24,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:24,000 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,001 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:24,001 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:24,001 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,001 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091673218b8f8f894ba8a0c30310c5e7e589, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309167f67e64af6ec48cfb600ff7cbe41c808] mob files 2023-09-16 16:02:24,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091673218b8f8f894ba8a0c30310c5e7e589 2023-09-16 16:02:24,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-16 16:02:24,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309167f67e64af6ec48cfb600ff7cbe41c808 2023-09-16 16:02:24,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:02:24,002 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:02:24,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-16 16:02:24,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,029 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:24,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694880143898Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694880144008 (+110 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694880144008Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694880144008Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694880144013 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694880144020 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694880144029 (+9 ms) 2023-09-16 16:02:24,031 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-16 16:02:24,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 132 msec 2023-09-16 16:02:24,202 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:24,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-16 16:02:24,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:02:24,231 DEBUG [Listener at jenkins-hbase4.apache.org/42447] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-16 16:02:24,234 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-16 16:02:24,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35809] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-16 16:02:24,236 DEBUG [Listener at jenkins-hbase4.apache.org/42447] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-16 16:02:24,239 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-16 16:02:24,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-16 16:02:24,239 DEBUG [Listener at jenkins-hbase4.apache.org/42447] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-16 16:02:24,242 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-16 16:02:24,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45159] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-16 16:02:24,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-16 16:02:24,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:24,246 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:02:24,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-16 16:02:24,247 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:02:24,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-16 16:02:24,249 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,249 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,250 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90 empty. 2023-09-16 16:02:24,250 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd empty. 2023-09-16 16:02:24,250 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,250 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,250 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-16 16:02:24,259 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-16 16:02:24,260 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6bdd4df67bf88139c00a798df83f8abd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:24,260 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 436cf32c4d7069655f1f37b4908ace90, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 6bdd4df67bf88139c00a798df83f8abd, disabling compactions & flushes 2023-09-16 16:02:24,270 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. after waiting 0 ms 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 436cf32c4d7069655f1f37b4908ace90, disabling compactions & flushes 2023-09-16 16:02:24,270 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:24,270 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 6bdd4df67bf88139c00a798df83f8abd: 2023-09-16 16:02:24,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:24,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. after waiting 0 ms 2023-09-16 16:02:24,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:24,271 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:24,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 436cf32c4d7069655f1f37b4908ace90: 2023-09-16 16:02:24,273 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:02:24,273 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880144273"}]},"ts":"1694880144273"} 2023-09-16 16:02:24,274 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880144273"}]},"ts":"1694880144273"} 2023-09-16 16:02:24,275 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-16 16:02:24,276 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:02:24,276 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880144276"}]},"ts":"1694880144276"} 2023-09-16 16:02:24,277 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-16 16:02:24,280 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:02:24,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:02:24,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:02:24,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:02:24,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:02:24,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=436cf32c4d7069655f1f37b4908ace90, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bdd4df67bf88139c00a798df83f8abd, ASSIGN}] 2023-09-16 16:02:24,284 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=436cf32c4d7069655f1f37b4908ace90, ASSIGN 2023-09-16 16:02:24,284 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bdd4df67bf88139c00a798df83f8abd, ASSIGN 2023-09-16 16:02:24,284 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=436cf32c4d7069655f1f37b4908ace90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45159,1694880071982; forceNewPlan=false, retain=false 2023-09-16 16:02:24,284 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bdd4df67bf88139c00a798df83f8abd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1694880072020; forceNewPlan=false, retain=false 2023-09-16 16:02:24,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-16 16:02:24,434 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-16 16:02:24,437 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6bdd4df67bf88139c00a798df83f8abd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:24,437 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=436cf32c4d7069655f1f37b4908ace90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:24,437 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880144437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880144437"}]},"ts":"1694880144437"} 2023-09-16 16:02:24,437 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880144437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880144437"}]},"ts":"1694880144437"} 2023-09-16 16:02:24,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 6bdd4df67bf88139c00a798df83f8abd, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:02:24,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 436cf32c4d7069655f1f37b4908ace90, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:24,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-16 16:02:24,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:24,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:24,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 436cf32c4d7069655f1f37b4908ace90, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.', STARTKEY => '', ENDKEY => '2'} 2023-09-16 16:02:24,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bdd4df67bf88139c00a798df83f8abd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.', STARTKEY => '2', ENDKEY => ''} 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. service=AccessControlService 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. service=AccessControlService 2023-09-16 16:02:24,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:24,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,597 INFO [StoreOpener-6bdd4df67bf88139c00a798df83f8abd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,597 INFO [StoreOpener-436cf32c4d7069655f1f37b4908ace90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,598 DEBUG [StoreOpener-6bdd4df67bf88139c00a798df83f8abd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf 2023-09-16 16:02:24,598 DEBUG [StoreOpener-436cf32c4d7069655f1f37b4908ace90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf 2023-09-16 16:02:24,598 DEBUG [StoreOpener-6bdd4df67bf88139c00a798df83f8abd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf 2023-09-16 16:02:24,598 DEBUG [StoreOpener-436cf32c4d7069655f1f37b4908ace90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf 2023-09-16 16:02:24,598 INFO [StoreOpener-6bdd4df67bf88139c00a798df83f8abd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bdd4df67bf88139c00a798df83f8abd columnFamilyName cf 2023-09-16 16:02:24,599 INFO [StoreOpener-436cf32c4d7069655f1f37b4908ace90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 436cf32c4d7069655f1f37b4908ace90 columnFamilyName cf 2023-09-16 16:02:24,599 INFO [StoreOpener-6bdd4df67bf88139c00a798df83f8abd-1] regionserver.HStore(310): Store=6bdd4df67bf88139c00a798df83f8abd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:24,599 INFO [StoreOpener-436cf32c4d7069655f1f37b4908ace90-1] regionserver.HStore(310): Store=436cf32c4d7069655f1f37b4908ace90/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:24,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:24,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:24,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:24,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 436cf32c4d7069655f1f37b4908ace90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71954964, jitterRate=0.07221251726150513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:24,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bdd4df67bf88139c00a798df83f8abd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64780465, jitterRate=-0.03469584882259369}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:24,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 436cf32c4d7069655f1f37b4908ace90: 2023-09-16 16:02:24,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bdd4df67bf88139c00a798df83f8abd: 2023-09-16 16:02:24,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90., pid=70, masterSystemTime=1694880144591 2023-09-16 16:02:24,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd., pid=69, masterSystemTime=1694880144591 2023-09-16 16:02:24,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:24,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:24,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=436cf32c4d7069655f1f37b4908ace90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:24,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:24,609 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880144608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880144608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880144608"}]},"ts":"1694880144608"} 2023-09-16 16:02:24,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:24,609 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6bdd4df67bf88139c00a798df83f8abd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:24,609 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144609"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880144609"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880144609"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880144609"}]},"ts":"1694880144609"} 2023-09-16 16:02:24,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-16 16:02:24,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 436cf32c4d7069655f1f37b4908ace90, server=jenkins-hbase4.apache.org,45159,1694880071982 in 170 msec 2023-09-16 16:02:24,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-16 16:02:24,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 6bdd4df67bf88139c00a798df83f8abd, server=jenkins-hbase4.apache.org,42403,1694880072020 in 172 msec 2023-09-16 16:02:24,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=436cf32c4d7069655f1f37b4908ace90, ASSIGN in 331 msec 2023-09-16 16:02:24,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-16 16:02:24,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bdd4df67bf88139c00a798df83f8abd, ASSIGN in 332 msec 2023-09-16 16:02:24,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:02:24,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880144615"}]},"ts":"1694880144615"} 2023-09-16 16:02:24,616 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-16 16:02:24,622 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:02:24,623 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-16 16:02:24,624 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-16 16:02:24,632 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:24,632 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:24,632 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:24,632 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:24,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 396 msec 2023-09-16 16:02:24,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-16 16:02:24,851 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-16 16:02:24,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 436cf32c4d7069655f1f37b4908ace90, 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:24,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[436cf32c4d7069655f1f37b4908ace90, 6bdd4df67bf88139c00a798df83f8abd], force=true 2023-09-16 16:02:24,883 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[436cf32c4d7069655f1f37b4908ace90, 6bdd4df67bf88139c00a798df83f8abd], force=true 2023-09-16 16:02:24,883 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[436cf32c4d7069655f1f37b4908ace90, 6bdd4df67bf88139c00a798df83f8abd], force=true 2023-09-16 16:02:24,883 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[436cf32c4d7069655f1f37b4908ace90, 6bdd4df67bf88139c00a798df83f8abd], force=true 2023-09-16 16:02:24,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-16 16:02:24,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=436cf32c4d7069655f1f37b4908ace90, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bdd4df67bf88139c00a798df83f8abd, UNASSIGN}] 2023-09-16 16:02:24,907 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=436cf32c4d7069655f1f37b4908ace90, UNASSIGN 2023-09-16 16:02:24,907 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bdd4df67bf88139c00a798df83f8abd, UNASSIGN 2023-09-16 16:02:24,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=436cf32c4d7069655f1f37b4908ace90, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:24,908 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6bdd4df67bf88139c00a798df83f8abd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:24,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880144908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880144908"}]},"ts":"1694880144908"} 2023-09-16 16:02:24,908 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880144908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880144908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880144908"}]},"ts":"1694880144908"} 2023-09-16 16:02:24,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 436cf32c4d7069655f1f37b4908ace90, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:24,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 6bdd4df67bf88139c00a798df83f8abd, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:02:24,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-16 16:02:25,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:25,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 436cf32c4d7069655f1f37b4908ace90, disabling compactions & flushes 2023-09-16 16:02:25,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:25,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:25,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. after waiting 0 ms 2023-09-16 16:02:25,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:25,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 436cf32c4d7069655f1f37b4908ace90 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-16 16:02:25,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:25,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bdd4df67bf88139c00a798df83f8abd, disabling compactions & flushes 2023-09-16 16:02:25,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:25,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:25,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. after waiting 0 ms 2023-09-16 16:02:25,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:25,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6bdd4df67bf88139c00a798df83f8abd 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-16 16:02:25,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/.tmp/cf/14cb2566fb954154814c7dce672dbac3 2023-09-16 16:02:25,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/.tmp/cf/d225f5757e414000ad76f0f34552ce9f 2023-09-16 16:02:25,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/.tmp/cf/d225f5757e414000ad76f0f34552ce9f as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf/d225f5757e414000ad76f0f34552ce9f 2023-09-16 16:02:25,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/.tmp/cf/14cb2566fb954154814c7dce672dbac3 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf/14cb2566fb954154814c7dce672dbac3 2023-09-16 16:02:25,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf/14cb2566fb954154814c7dce672dbac3, entries=1, sequenceid=5, filesize=4.7 K 2023-09-16 16:02:25,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf/d225f5757e414000ad76f0f34552ce9f, entries=1, sequenceid=5, filesize=4.7 K 2023-09-16 16:02:25,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6bdd4df67bf88139c00a798df83f8abd in 21ms, sequenceid=5, compaction requested=false 2023-09-16 16:02:25,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 436cf32c4d7069655f1f37b4908ace90 in 23ms, sequenceid=5, compaction requested=false 2023-09-16 16:02:25,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-16 16:02:25,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-16 16:02:25,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-16 16:02:25,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-16 16:02:25,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:25,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:25,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90. 2023-09-16 16:02:25,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 436cf32c4d7069655f1f37b4908ace90: 2023-09-16 16:02:25,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd. 2023-09-16 16:02:25,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bdd4df67bf88139c00a798df83f8abd: 2023-09-16 16:02:25,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:25,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=436cf32c4d7069655f1f37b4908ace90, regionState=CLOSED 2023-09-16 16:02:25,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:25,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880145098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880145098"}]},"ts":"1694880145098"} 2023-09-16 16:02:25,099 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6bdd4df67bf88139c00a798df83f8abd, regionState=CLOSED 2023-09-16 16:02:25,099 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694880145099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880145099"}]},"ts":"1694880145099"} 2023-09-16 16:02:25,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-16 16:02:25,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 436cf32c4d7069655f1f37b4908ace90, server=jenkins-hbase4.apache.org,45159,1694880071982 in 190 msec 2023-09-16 16:02:25,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-16 16:02:25,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 6bdd4df67bf88139c00a798df83f8abd, server=jenkins-hbase4.apache.org,42403,1694880072020 in 190 msec 2023-09-16 16:02:25,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=436cf32c4d7069655f1f37b4908ace90, UNASSIGN in 198 msec 2023-09-16 16:02:25,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-16 16:02:25,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bdd4df67bf88139c00a798df83f8abd, UNASSIGN in 197 msec 2023-09-16 16:02:25,146 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-16 16:02:25,147 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144243.436cf32c4d7069655f1f37b4908ace90.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:25,148 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694880144243.6bdd4df67bf88139c00a798df83f8abd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:25,148 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:25,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-16 16:02:25,195 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=75e8e48d60ce5289bf0d179ef6c42aea, ASSIGN}] 2023-09-16 16:02:25,196 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=75e8e48d60ce5289bf0d179ef6c42aea, ASSIGN 2023-09-16 16:02:25,197 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=75e8e48d60ce5289bf0d179ef6c42aea, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45159,1694880071982; forceNewPlan=false, retain=false 2023-09-16 16:02:25,347 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-16 16:02:25,349 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=75e8e48d60ce5289bf0d179ef6c42aea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:25,349 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694880145349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880145349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880145349"}]},"ts":"1694880145349"} 2023-09-16 16:02:25,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 75e8e48d60ce5289bf0d179ef6c42aea, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:25,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-16 16:02:25,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75e8e48d60ce5289bf0d179ef6c42aea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.', STARTKEY => '', ENDKEY => ''} 2023-09-16 16:02:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. service=AccessControlService 2023-09-16 16:02:25,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:25,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/.regioninfo 2023-09-16 16:02:25,516 INFO [StoreOpener-75e8e48d60ce5289bf0d179ef6c42aea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:25,517 DEBUG [StoreOpener-75e8e48d60ce5289bf0d179ef6c42aea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf 2023-09-16 16:02:25,517 DEBUG [StoreOpener-75e8e48d60ce5289bf0d179ef6c42aea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf 2023-09-16 16:02:25,518 INFO [StoreOpener-75e8e48d60ce5289bf0d179ef6c42aea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75e8e48d60ce5289bf0d179ef6c42aea columnFamilyName cf 2023-09-16 16:02:25,544 DEBUG [StoreOpener-75e8e48d60ce5289bf0d179ef6c42aea-1] regionserver.HStore(539): loaded hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/14cb2566fb954154814c7dce672dbac3.6bdd4df67bf88139c00a798df83f8abd->hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf/14cb2566fb954154814c7dce672dbac3-top 2023-09-16 16:02:25,549 DEBUG [StoreOpener-75e8e48d60ce5289bf0d179ef6c42aea-1] regionserver.HStore(539): loaded hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/d225f5757e414000ad76f0f34552ce9f.436cf32c4d7069655f1f37b4908ace90->hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf/d225f5757e414000ad76f0f34552ce9f-top 2023-09-16 16:02:25,550 INFO [StoreOpener-75e8e48d60ce5289bf0d179ef6c42aea-1] regionserver.HStore(310): Store=75e8e48d60ce5289bf0d179ef6c42aea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:25,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:25,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:25,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:25,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 75e8e48d60ce5289bf0d179ef6c42aea; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74106418, jitterRate=0.10427168011665344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:25,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 75e8e48d60ce5289bf0d179ef6c42aea: 2023-09-16 16:02:25,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea., pid=77, masterSystemTime=1694880145502 2023-09-16 16:02:25,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.,because compaction is disabled. 2023-09-16 16:02:25,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:25,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:25,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=75e8e48d60ce5289bf0d179ef6c42aea, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:25,558 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694880145557"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880145557"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880145557"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880145557"}]},"ts":"1694880145557"} 2023-09-16 16:02:25,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-16 16:02:25,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 75e8e48d60ce5289bf0d179ef6c42aea, server=jenkins-hbase4.apache.org,45159,1694880071982 in 208 msec 2023-09-16 16:02:25,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-16 16:02:25,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=75e8e48d60ce5289bf0d179ef6c42aea, ASSIGN in 365 msec 2023-09-16 16:02:25,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[436cf32c4d7069655f1f37b4908ace90, 6bdd4df67bf88139c00a798df83f8abd], force=true in 687 msec 2023-09-16 16:02:25,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-16 16:02:25,990 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-16 16:02:25,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-16 16:02:25,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880145991 (current time:1694880145991). 2023-09-16 16:02:25,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:02:25,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x7adc8cd4 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:25,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34bd963d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:26,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:26,002 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:26,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7adc8cd4 to 127.0.0.1:61309 2023-09-16 16:02:26,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:26,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x5e1ae00c to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:26,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40be7d37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:26,011 DEBUG [hconnection-0x18ea0763-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:26,013 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:26,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:26,019 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:26,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e1ae00c to 127.0.0.1:61309 2023-09-16 16:02:26,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:26,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-16 16:02:26,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:02:26,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-16 16:02:26,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-16 16:02:26,024 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-16 16:02:26,025 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694880746025 2023-09-16 16:02:26,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-16 16:02:26,025 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,028 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:02:26,028 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:02:26,030 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-16 16:02:26,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-16 16:02:26,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-16 16:02:26,031 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-16 16:02:26,032 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694880746032 2023-09-16 16:02:26,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,040 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-16 16:02:26,040 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:26,041 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-16 16:02:26,041 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-16 16:02:26,042 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,042 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,043 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:26,043 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:26,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:26,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:26,043 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,043 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:26,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,044 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,044 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-16 16:02:26,044 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-16 16:02:26,045 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-16 16:02:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,045 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-16 16:02:26,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,046 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-16 16:02:26,046 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-16 16:02:26,046 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:26,046 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-16 16:02:26,046 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-16 16:02:26,047 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-16 16:02:26,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,047 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-16 16:02:26,047 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-16 16:02:26,047 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-16 16:02:26,047 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-16 16:02:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-16 16:02:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-16 16:02:26,049 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,050 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,051 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,051 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:26,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:26,051 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:26,051 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,051 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,052 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:26,052 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,052 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:26,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-16 16:02:26,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75403111[Count = 0] remaining members to acquire global barrier 2023-09-16 16:02:26,054 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-16 16:02:26,054 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-16 16:02:26,055 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,055 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:02:26,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,055 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-16 16:02:26,056 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-16 16:02:26,056 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-16 16:02:26,056 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-16 16:02:26,056 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:02:26,056 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:02:26,057 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:26,057 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:26,057 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:26,057 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. started... 2023-09-16 16:02:26,058 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75e8e48d60ce5289bf0d179ef6c42aea: 2023-09-16 16:02:26,058 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-16 16:02:26,058 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,058 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:26,058 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:26,058 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-16 16:02:26,059 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/14cb2566fb954154814c7dce672dbac3.6bdd4df67bf88139c00a798df83f8abd->hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf/14cb2566fb954154814c7dce672dbac3-top, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/d225f5757e414000ad76f0f34552ce9f.436cf32c4d7069655f1f37b4908ace90->hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf/d225f5757e414000ad76f0f34552ce9f-top] hfiles 2023-09-16 16:02:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-16 16:02:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:26,059 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/14cb2566fb954154814c7dce672dbac3.6bdd4df67bf88139c00a798df83f8abd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-16 16:02:26,063 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/d225f5757e414000ad76f0f34552ce9f.436cf32c4d7069655f1f37b4908ace90 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,069 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. completed. 2023-09-16 16:02:26,069 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:26,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:26,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:26,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-16 16:02:26,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:02:26,073 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-16 16:02:26,073 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,073 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:26,074 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-16 16:02:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:02:26,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-16 16:02:26,077 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-16 16:02:26,077 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:02:26,077 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:02:26,077 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,077 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:02:26,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:26,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,079 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,080 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:26,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:26,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:26,080 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,081 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,082 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,083 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:26,083 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,086 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,086 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,086 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:26,086 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:26,086 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:26,086 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:26,086 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:26,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:26,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:26,087 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:26,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:26,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:26,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:26,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:26,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,106 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-16 16:02:26,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,106 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694880146025Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694880146087 (+62 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694880146087Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694880146090 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694880146098 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694880146106 (+8 ms) 2023-09-16 16:02:26,109 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-16 16:02:26,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 81 msec 2023-09-16 16:02:26,128 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:26,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-16 16:02:26,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:02:26,129 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129 2023-09-16 16:02:26,129 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42433, tgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129, rawTgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129, srcFsUri=hdfs://localhost:42433, srcDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:26,151 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:26,151 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-202593621_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,151 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, snapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-16 16:02:26,159 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:26,176 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,057 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-6916760031418679542.jar 2023-09-16 16:02:27,057 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,057 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,124 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-3612615344409970107.jar 2023-09-16 16:02:27,124 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,124 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,125 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,125 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,126 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,126 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:27,126 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-16 16:02:27,127 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-16 16:02:27,127 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-16 16:02:27,127 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-16 16:02:27,128 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-16 16:02:27,128 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-16 16:02:27,129 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-16 16:02:27,129 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-16 16:02:27,129 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-16 16:02:27,130 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-16 16:02:27,130 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:27,131 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:27,131 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:27,131 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:27,132 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:27,132 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:27,133 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:27,474 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0004_000001 (auth:SIMPLE) 2023-09-16 16:02:27,491 WARN [Listener at jenkins-hbase4.apache.org/42447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-16 16:02:27,493 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-16 16:02:27,495 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-16 16:02:27,548 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:27,548 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:28,359 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:02:28,429 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0005_000001 (auth:SIMPLE) 2023-09-16 16:02:32,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0005_000001 (auth:SIMPLE) 2023-09-16 16:02:34,264 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0005_000001 (auth:SIMPLE) 2023-09-16 16:02:36,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0005_000001 (auth:SIMPLE) 2023-09-16 16:02:38,650 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-16 16:02:38,653 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-16 16:02:38,661 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,661 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-16 16:02:38,661 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-16 16:02:38,662 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,662 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-16 16:02:38,662 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-16 16:02:38,662 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,663 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-16 16:02:38,663 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880146129/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-16 16:02:38,668 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-16 16:02:38,672 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880158672"}]},"ts":"1694880158672"} 2023-09-16 16:02:38,674 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-16 16:02:38,675 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-16 16:02:38,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=75e8e48d60ce5289bf0d179ef6c42aea, UNASSIGN}] 2023-09-16 16:02:38,677 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=75e8e48d60ce5289bf0d179ef6c42aea, UNASSIGN 2023-09-16 16:02:38,678 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=75e8e48d60ce5289bf0d179ef6c42aea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:38,678 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694880158678"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880158678"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880158678"}]},"ts":"1694880158678"} 2023-09-16 16:02:38,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 75e8e48d60ce5289bf0d179ef6c42aea, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:38,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-16 16:02:38,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:38,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 75e8e48d60ce5289bf0d179ef6c42aea, disabling compactions & flushes 2023-09-16 16:02:38,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:38,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:38,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. after waiting 0 ms 2023-09-16 16:02:38,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:38,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-16 16:02:38,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:38,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea. 2023-09-16 16:02:38,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 75e8e48d60ce5289bf0d179ef6c42aea: 2023-09-16 16:02:38,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:38,844 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=75e8e48d60ce5289bf0d179ef6c42aea, regionState=CLOSED 2023-09-16 16:02:38,845 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694880158844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880158844"}]},"ts":"1694880158844"} 2023-09-16 16:02:38,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-16 16:02:38,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 75e8e48d60ce5289bf0d179ef6c42aea, server=jenkins-hbase4.apache.org,45159,1694880071982 in 167 msec 2023-09-16 16:02:38,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-16 16:02:38,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=75e8e48d60ce5289bf0d179ef6c42aea, UNASSIGN in 171 msec 2023-09-16 16:02:38,849 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880158849"}]},"ts":"1694880158849"} 2023-09-16 16:02:38,850 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-16 16:02:38,852 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-16 16:02:38,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 183 msec 2023-09-16 16:02:38,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-16 16:02:38,975 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-16 16:02:38,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,978 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,979 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,980 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,983 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:38,983 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:38,983 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:38,985 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/recovered.edits] 2023-09-16 16:02:38,985 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/recovered.edits] 2023-09-16 16:02:38,985 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/recovered.edits] 2023-09-16 16:02:38,987 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,987 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,987 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,987 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-16 16:02:38,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-16 16:02:38,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-16 16:02:38,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-16 16:02:38,988 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:38,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:38,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:38,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:38,989 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:38,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-16 16:02:38,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:38,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:38,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:38,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:38,991 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/14cb2566fb954154814c7dce672dbac3.6bdd4df67bf88139c00a798df83f8abd to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/14cb2566fb954154814c7dce672dbac3.6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:38,991 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf/14cb2566fb954154814c7dce672dbac3 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/cf/14cb2566fb954154814c7dce672dbac3 2023-09-16 16:02:38,992 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf/d225f5757e414000ad76f0f34552ce9f to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/cf/d225f5757e414000ad76f0f34552ce9f 2023-09-16 16:02:38,993 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/d225f5757e414000ad76f0f34552ce9f.436cf32c4d7069655f1f37b4908ace90 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/cf/d225f5757e414000ad76f0f34552ce9f.436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:38,995 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/recovered.edits/8.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd/recovered.edits/8.seqid 2023-09-16 16:02:38,995 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bdd4df67bf88139c00a798df83f8abd 2023-09-16 16:02:38,996 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/recovered.edits/8.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90/recovered.edits/8.seqid 2023-09-16 16:02:38,996 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/recovered.edits/12.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea/recovered.edits/12.seqid 2023-09-16 16:02:38,996 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/436cf32c4d7069655f1f37b4908ace90 2023-09-16 16:02:38,996 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/75e8e48d60ce5289bf0d179ef6c42aea 2023-09-16 16:02:38,997 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-16 16:02:38,998 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:39,001 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-16 16:02:39,002 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-16 16:02:39,003 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:39,003 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-16 16:02:39,003 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880159003"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:39,004 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-16 16:02:39,004 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 75e8e48d60ce5289bf0d179ef6c42aea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694880144244.75e8e48d60ce5289bf0d179ef6c42aea.', STARTKEY => '', ENDKEY => ''}] 2023-09-16 16:02:39,005 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-16 16:02:39,005 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694880159005"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:39,006 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-16 16:02:39,007 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:39,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 32 msec 2023-09-16 16:02:39,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-16 16:02:39,091 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-16 16:02:39,092 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-16 16:02:39,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880159096"}]},"ts":"1694880159096"} 2023-09-16 16:02:39,097 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-16 16:02:39,099 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-16 16:02:39,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc49bf66056897645084b6137762027a, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fe3478eef60f40d302665bf000a204, UNASSIGN}] 2023-09-16 16:02:39,102 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc49bf66056897645084b6137762027a, UNASSIGN 2023-09-16 16:02:39,102 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fe3478eef60f40d302665bf000a204, UNASSIGN 2023-09-16 16:02:39,102 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=08fe3478eef60f40d302665bf000a204, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:39,102 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bc49bf66056897645084b6137762027a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:39,103 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880159102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880159102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880159102"}]},"ts":"1694880159102"} 2023-09-16 16:02:39,103 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880159102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880159102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880159102"}]},"ts":"1694880159102"} 2023-09-16 16:02:39,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 08fe3478eef60f40d302665bf000a204, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:02:39,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure bc49bf66056897645084b6137762027a, server=jenkins-hbase4.apache.org,42403,1694880072020}] 2023-09-16 16:02:39,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-16 16:02:39,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:39,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bc49bf66056897645084b6137762027a 2023-09-16 16:02:39,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bc49bf66056897645084b6137762027a, disabling compactions & flushes 2023-09-16 16:02:39,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 08fe3478eef60f40d302665bf000a204, disabling compactions & flushes 2023-09-16 16:02:39,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:39,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:39,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:39,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:39,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. after waiting 0 ms 2023-09-16 16:02:39,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:39,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. after waiting 0 ms 2023-09-16 16:02:39,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:39,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:02:39,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:02:39,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:39,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:39,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204. 2023-09-16 16:02:39,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 08fe3478eef60f40d302665bf000a204: 2023-09-16 16:02:39,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a. 2023-09-16 16:02:39,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bc49bf66056897645084b6137762027a: 2023-09-16 16:02:39,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:39,271 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=08fe3478eef60f40d302665bf000a204, regionState=CLOSED 2023-09-16 16:02:39,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880159271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880159271"}]},"ts":"1694880159271"} 2023-09-16 16:02:39,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bc49bf66056897645084b6137762027a 2023-09-16 16:02:39,272 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bc49bf66056897645084b6137762027a, regionState=CLOSED 2023-09-16 16:02:39,272 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694880159272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880159272"}]},"ts":"1694880159272"} 2023-09-16 16:02:39,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-16 16:02:39,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 08fe3478eef60f40d302665bf000a204, server=jenkins-hbase4.apache.org,35809,1694880071932 in 169 msec 2023-09-16 16:02:39,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-16 16:02:39,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure bc49bf66056897645084b6137762027a, server=jenkins-hbase4.apache.org,42403,1694880072020 in 170 msec 2023-09-16 16:02:39,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fe3478eef60f40d302665bf000a204, UNASSIGN in 175 msec 2023-09-16 16:02:39,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-16 16:02:39,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc49bf66056897645084b6137762027a, UNASSIGN in 175 msec 2023-09-16 16:02:39,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880159277"}]},"ts":"1694880159277"} 2023-09-16 16:02:39,278 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-16 16:02:39,279 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-16 16:02:39,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-09-16 16:02:39,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-16 16:02:39,399 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-16 16:02:39,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,402 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,403 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,404 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,407 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,407 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,407 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,407 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,407 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a 2023-09-16 16:02:39,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-16 16:02:39,407 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:39,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-16 16:02:39,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-16 16:02:39,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,409 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,409 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/recovered.edits] 2023-09-16 16:02:39,409 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/recovered.edits] 2023-09-16 16:02:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-16 16:02:39,413 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf/1aaee1b8ce774534a7a511c5aae7a10f to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/cf/1aaee1b8ce774534a7a511c5aae7a10f 2023-09-16 16:02:39,414 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf/3caa10a0cf864a7bba0dd2394cbe6285 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/cf/3caa10a0cf864a7bba0dd2394cbe6285 2023-09-16 16:02:39,416 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a/recovered.edits/9.seqid 2023-09-16 16:02:39,416 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204/recovered.edits/9.seqid 2023-09-16 16:02:39,417 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc49bf66056897645084b6137762027a 2023-09-16 16:02:39,417 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fe3478eef60f40d302665bf000a204 2023-09-16 16:02:39,417 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-16 16:02:39,418 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-16 16:02:39,418 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-16 16:02:39,421 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091673218b8f8f894ba8a0c30310c5e7e589 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091673218b8f8f894ba8a0c30310c5e7e589 2023-09-16 16:02:39,422 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309167f67e64af6ec48cfb600ff7cbe41c808 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309167f67e64af6ec48cfb600ff7cbe41c808 2023-09-16 16:02:39,422 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-16 16:02:39,424 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,426 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-16 16:02:39,428 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-16 16:02:39,429 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,429 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-16 16:02:39,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880159429"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:39,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880159429"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:39,430 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-16 16:02:39,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bc49bf66056897645084b6137762027a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694880143090.bc49bf66056897645084b6137762027a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 08fe3478eef60f40d302665bf000a204, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694880143090.08fe3478eef60f40d302665bf000a204.', STARTKEY => '1', ENDKEY => ''}] 2023-09-16 16:02:39,430 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-16 16:02:39,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694880159430"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:39,432 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-16 16:02:39,434 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-16 16:02:39,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-16 16:02:39,512 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-16 16:02:39,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-16 16:02:39,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-16 16:02:39,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-16 16:02:39,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-16 16:02:39,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-16 16:02:39,551 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 752) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:38222 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:42190 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:38600 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:41959 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_254534000_1 at /127.0.0.1:42158 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 179), ProcessCount=168 (was 168), AvailableMemoryMB=7265 (was 7178) - AvailableMemoryMB LEAK? - 2023-09-16 16:02:39,552 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-16 16:02:39,570 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=168, AvailableMemoryMB=7264 2023-09-16 16:02:39,570 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-16 16:02:39,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-16 16:02:39,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:39,574 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:02:39,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-16 16:02:39,574 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:02:39,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-16 16:02:39,576 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,576 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,577 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0 empty. 2023-09-16 16:02:39,577 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d empty. 2023-09-16 16:02:39,577 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,577 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,577 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-16 16:02:39,586 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-16 16:02:39,588 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 673ecb948b9e54c2d357374d8f526b8d, NAME => 'testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:39,588 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93390ed0fb171815b1050a3eada639d0, NAME => 'testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 673ecb948b9e54c2d357374d8f526b8d, disabling compactions & flushes 2023-09-16 16:02:39,595 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. after waiting 0 ms 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 93390ed0fb171815b1050a3eada639d0, disabling compactions & flushes 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:39,595 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:39,595 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 673ecb948b9e54c2d357374d8f526b8d: 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. after waiting 0 ms 2023-09-16 16:02:39,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:39,595 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:39,596 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 93390ed0fb171815b1050a3eada639d0: 2023-09-16 16:02:39,597 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:02:39,598 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880159598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880159598"}]},"ts":"1694880159598"} 2023-09-16 16:02:39,598 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880159598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880159598"}]},"ts":"1694880159598"} 2023-09-16 16:02:39,600 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-16 16:02:39,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:02:39,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880159601"}]},"ts":"1694880159601"} 2023-09-16 16:02:39,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-16 16:02:39,605 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:02:39,606 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:02:39,606 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:02:39,606 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:02:39,606 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:02:39,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93390ed0fb171815b1050a3eada639d0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=673ecb948b9e54c2d357374d8f526b8d, ASSIGN}] 2023-09-16 16:02:39,609 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93390ed0fb171815b1050a3eada639d0, ASSIGN 2023-09-16 16:02:39,609 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=673ecb948b9e54c2d357374d8f526b8d, ASSIGN 2023-09-16 16:02:39,609 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93390ed0fb171815b1050a3eada639d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35809,1694880071932; forceNewPlan=false, retain=false 2023-09-16 16:02:39,609 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=673ecb948b9e54c2d357374d8f526b8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45159,1694880071982; forceNewPlan=false, retain=false 2023-09-16 16:02:39,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-16 16:02:39,759 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-16 16:02:39,762 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=93390ed0fb171815b1050a3eada639d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:39,762 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=673ecb948b9e54c2d357374d8f526b8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:39,762 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880159762"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880159762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880159762"}]},"ts":"1694880159762"} 2023-09-16 16:02:39,762 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880159762"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880159762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880159762"}]},"ts":"1694880159762"} 2023-09-16 16:02:39,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 673ecb948b9e54c2d357374d8f526b8d, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:39,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 93390ed0fb171815b1050a3eada639d0, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:02:39,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-16 16:02:39,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:39,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 673ecb948b9e54c2d357374d8f526b8d, NAME => 'testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.', STARTKEY => '1', ENDKEY => ''} 2023-09-16 16:02:39,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:39,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. service=AccessControlService 2023-09-16 16:02:39,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93390ed0fb171815b1050a3eada639d0, NAME => 'testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.', STARTKEY => '', ENDKEY => '1'} 2023-09-16 16:02:39,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. service=AccessControlService 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,921 INFO [StoreOpener-673ecb948b9e54c2d357374d8f526b8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,922 INFO [StoreOpener-93390ed0fb171815b1050a3eada639d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,922 DEBUG [StoreOpener-673ecb948b9e54c2d357374d8f526b8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf 2023-09-16 16:02:39,922 DEBUG [StoreOpener-673ecb948b9e54c2d357374d8f526b8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf 2023-09-16 16:02:39,923 DEBUG [StoreOpener-93390ed0fb171815b1050a3eada639d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf 2023-09-16 16:02:39,923 DEBUG [StoreOpener-93390ed0fb171815b1050a3eada639d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf 2023-09-16 16:02:39,923 INFO [StoreOpener-673ecb948b9e54c2d357374d8f526b8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 673ecb948b9e54c2d357374d8f526b8d columnFamilyName cf 2023-09-16 16:02:39,923 INFO [StoreOpener-93390ed0fb171815b1050a3eada639d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93390ed0fb171815b1050a3eada639d0 columnFamilyName cf 2023-09-16 16:02:39,924 INFO [StoreOpener-93390ed0fb171815b1050a3eada639d0-1] regionserver.HStore(310): Store=93390ed0fb171815b1050a3eada639d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:39,924 INFO [StoreOpener-673ecb948b9e54c2d357374d8f526b8d-1] regionserver.HStore(310): Store=673ecb948b9e54c2d357374d8f526b8d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:39,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:39,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:39,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:39,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:39,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 673ecb948b9e54c2d357374d8f526b8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70533368, jitterRate=0.051029086112976074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:39,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 93390ed0fb171815b1050a3eada639d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71558788, jitterRate=0.06630903482437134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:39,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 673ecb948b9e54c2d357374d8f526b8d: 2023-09-16 16:02:39,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 93390ed0fb171815b1050a3eada639d0: 2023-09-16 16:02:39,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d., pid=93, masterSystemTime=1694880159916 2023-09-16 16:02:39,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:39,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:39,933 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=673ecb948b9e54c2d357374d8f526b8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:39,933 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880159933"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880159933"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880159933"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880159933"}]},"ts":"1694880159933"} 2023-09-16 16:02:39,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-16 16:02:39,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 673ecb948b9e54c2d357374d8f526b8d, server=jenkins-hbase4.apache.org,45159,1694880071982 in 171 msec 2023-09-16 16:02:39,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=673ecb948b9e54c2d357374d8f526b8d, ASSIGN in 330 msec 2023-09-16 16:02:39,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0., pid=94, masterSystemTime=1694880159917 2023-09-16 16:02:39,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:39,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:39,946 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=93390ed0fb171815b1050a3eada639d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:39,946 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880159946"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880159946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880159946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880159946"}]},"ts":"1694880159946"} 2023-09-16 16:02:39,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-16 16:02:39,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 93390ed0fb171815b1050a3eada639d0, server=jenkins-hbase4.apache.org,35809,1694880071932 in 182 msec 2023-09-16 16:02:39,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-16 16:02:39,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93390ed0fb171815b1050a3eada639d0, ASSIGN in 343 msec 2023-09-16 16:02:39,951 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:02:39,951 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880159951"}]},"ts":"1694880159951"} 2023-09-16 16:02:39,952 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-16 16:02:39,955 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:02:39,955 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-16 16:02:39,957 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-16 16:02:39,958 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,958 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,958 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,958 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:39,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:39,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:39,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:39,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:39,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 388 msec 2023-09-16 16:02:40,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-16 16:02:40,178 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-16 16:02:40,180 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-16 16:02:40,180 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:40,182 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:02:40,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:02:40,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880160192 (current time:1694880160192). 2023-09-16 16:02:40,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:02:40,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x37a47667 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:40,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cb491a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:40,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:40,204 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:40,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37a47667 to 127.0.0.1:61309 2023-09-16 16:02:40,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:40,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x5eef8ab6 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:40,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a6cd842, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:40,212 DEBUG [hconnection-0x627d693e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:40,215 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:40,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:40,220 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:40,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5eef8ab6 to 127.0.0.1:61309 2023-09-16 16:02:40,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:40,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-16 16:02:40,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:02:40,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:02:40,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:02:40,225 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:02:40,226 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694880760226 2023-09-16 16:02:40,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:02:40,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-16 16:02:40,227 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:02:40,227 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:02:40,228 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:02:40,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-16 16:02:40,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-16 16:02:40,232 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-16 16:02:40,232 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694880760232 2023-09-16 16:02:40,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,240 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-16 16:02:40,240 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,241 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-16 16:02:40,241 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-16 16:02:40,241 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,242 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,248 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,248 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,248 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,248 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,248 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,249 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,249 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,249 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,250 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-16 16:02:40,250 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-16 16:02:40,250 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,251 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-16 16:02:40,251 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-16 16:02:40,250 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,251 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-16 16:02:40,251 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-16 16:02:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-16 16:02:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-16 16:02:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-16 16:02:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,253 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-16 16:02:40,253 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-16 16:02:40,253 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-16 16:02:40,254 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,254 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,255 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,255 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,257 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,257 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,257 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:40,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,257 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,257 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:40,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-16 16:02:40,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f409862[Count = 1] remaining members to acquire global barrier 2023-09-16 16:02:40,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,261 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,261 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:40,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-16 16:02:40,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f409862[Count = 0] remaining members to acquire global barrier 2023-09-16 16:02:40,261 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-16 16:02:40,261 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:02:40,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,263 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:02:40,263 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-16 16:02:40,263 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,263 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:02:40,263 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:02:40,263 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:40,263 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:40,263 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:40,263 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. started... 2023-09-16 16:02:40,263 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,263 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:02:40,263 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93390ed0fb171815b1050a3eada639d0: 2023-09-16 16:02:40,264 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,264 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:40,264 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:02:40,264 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-16 16:02:40,264 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,264 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-16 16:02:40,266 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:40,266 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:40,266 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:40,266 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. started... 2023-09-16 16:02:40,267 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 673ecb948b9e54c2d357374d8f526b8d: 2023-09-16 16:02:40,267 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,267 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:40,267 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:02:40,275 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. completed. 2023-09-16 16:02:40,275 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:40,275 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:40,275 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:40,275 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,275 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-16 16:02:40,275 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:02:40,276 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. completed. 2023-09-16 16:02:40,276 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:40,276 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:40,276 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:40,276 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,276 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-16 16:02:40,276 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:02:40,277 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,277 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-16 16:02:40,277 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,277 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-16 16:02:40,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,280 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,280 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-16 16:02:40,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,280 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,280 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-16 16:02:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:02:40,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-16 16:02:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:02:40,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-16 16:02:40,286 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-16 16:02:40,286 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:02:40,286 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:02:40,286 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,286 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:02:40,288 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,288 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,288 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,288 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,289 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,289 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,291 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,291 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,291 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,293 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,293 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,294 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,294 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,294 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,293 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,294 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,294 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-16 16:02:40,294 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,295 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,295 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,295 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:02:40,295 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,296 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,296 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,296 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,296 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,296 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-16 16:02:40,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-16 16:02:40,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,319 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694880160226Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694880160302 (+76 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694880160302Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694880160302Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694880160306 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694880160313 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694880160319 (+6 ms) 2023-09-16 16:02:40,322 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-16 16:02:40,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 95 msec 2023-09-16 16:02:40,327 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:40,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:02:40,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:02:40,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35809] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:02:40,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45159] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:02:40,333 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-16 16:02:40,333 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:40,334 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:02:40,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:02:40,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880160342 (current time:1694880160342). 2023-09-16 16:02:40,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:02:40,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x28d20d03 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:40,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21efa5be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:40,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:40,354 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:40,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28d20d03 to 127.0.0.1:61309 2023-09-16 16:02:40,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:40,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x47333f7d to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:40,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f31888d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:40,361 DEBUG [hconnection-0x23af1080-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:40,362 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:40,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:40,366 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:40,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47333f7d to 127.0.0.1:61309 2023-09-16 16:02:40,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:40,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-16 16:02:40,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:02:40,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:02:40,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:02:40,370 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:02:40,371 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694880760371 2023-09-16 16:02:40,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-16 16:02:40,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-16 16:02:40,372 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:02:40,372 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:02:40,373 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-16 16:02:40,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-16 16:02:40,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-16 16:02:40,375 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-16 16:02:40,375 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694880760375 2023-09-16 16:02:40,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,385 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-16 16:02:40,385 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,386 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-16 16:02:40,386 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-16 16:02:40,387 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,387 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,388 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,388 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,388 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,388 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,389 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,389 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,389 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,389 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-16 16:02:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,390 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-16 16:02:40,390 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-16 16:02:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-16 16:02:40,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,390 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-16 16:02:40,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,390 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-16 16:02:40,390 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-16 16:02:40,390 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,390 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,391 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-16 16:02:40,391 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-16 16:02:40,391 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-16 16:02:40,391 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-16 16:02:40,391 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-16 16:02:40,391 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:40,391 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-16 16:02:40,394 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-16 16:02:40,394 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-16 16:02:40,394 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-16 16:02:40,394 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-16 16:02:40,396 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,396 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,397 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,397 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26cff8c0[Count = 1] remaining members to acquire global barrier 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-16 16:02:40,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26cff8c0[Count = 0] remaining members to acquire global barrier 2023-09-16 16:02:40,400 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-16 16:02:40,400 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,404 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,404 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,404 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:02:40,405 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:40,405 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:02:40,405 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,405 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:40,405 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:40,405 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. started... 2023-09-16 16:02:40,405 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. started... 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-16 16:02:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:02:40,405 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 93390ed0fb171815b1050a3eada639d0 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-16 16:02:40,406 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 673ecb948b9e54c2d357374d8f526b8d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-16 16:02:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-16 16:02:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-16 16:02:40,423 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230916de8df86a3cad420281eb6d31b634564c to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230916de8df86a3cad420281eb6d31b634564c 2023-09-16 16:02:40,423 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309162c4aecba6eaf46658660e1b6c043ae21 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309162c4aecba6eaf46658660e1b6c043ae21 2023-09-16 16:02:40,430 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/.tmp/cf/d3954313a9aa499f81bab0a969827cf3 2023-09-16 16:02:40,430 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/.tmp/cf/e695917009844cda9dad5d383932d2fa 2023-09-16 16:02:40,434 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/.tmp/cf/d3954313a9aa499f81bab0a969827cf3 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf/d3954313a9aa499f81bab0a969827cf3 2023-09-16 16:02:40,435 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/.tmp/cf/e695917009844cda9dad5d383932d2fa as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf/e695917009844cda9dad5d383932d2fa 2023-09-16 16:02:40,439 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf/d3954313a9aa499f81bab0a969827cf3, entries=3, sequenceid=6, filesize=5.4 K 2023-09-16 16:02:40,439 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf/e695917009844cda9dad5d383932d2fa, entries=47, sequenceid=6, filesize=13.1 K 2023-09-16 16:02:40,440 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 93390ed0fb171815b1050a3eada639d0 in 35ms, sequenceid=6, compaction requested=false 2023-09-16 16:02:40,440 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 673ecb948b9e54c2d357374d8f526b8d in 35ms, sequenceid=6, compaction requested=false 2023-09-16 16:02:40,440 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-16 16:02:40,440 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-16 16:02:40,443 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 673ecb948b9e54c2d357374d8f526b8d: 2023-09-16 16:02:40,443 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93390ed0fb171815b1050a3eada639d0: 2023-09-16 16:02:40,443 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,443 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:40,443 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,444 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf/e695917009844cda9dad5d383932d2fa] hfiles 2023-09-16 16:02:40,444 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:40,444 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf/e695917009844cda9dad5d383932d2fa for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,444 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf/d3954313a9aa499f81bab0a969827cf3] hfiles 2023-09-16 16:02:40,444 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf/d3954313a9aa499f81bab0a969827cf3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,455 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. completed. 2023-09-16 16:02:40,455 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-16 16:02:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:02:40,456 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. completed. 2023-09-16 16:02:40,457 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:40,457 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:40,457 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:40,457 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,457 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-16 16:02:40,457 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:02:40,458 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,458 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-16 16:02:40,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,458 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,458 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-16 16:02:40,461 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-16 16:02:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-16 16:02:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:02:40,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-16 16:02:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:02:40,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-16 16:02:40,467 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-16 16:02:40,467 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:02:40,468 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:02:40,468 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,468 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:02:40,469 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:40,469 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,470 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,469 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,470 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:40,470 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:40,472 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,472 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,472 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,473 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:02:40,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:02:40,473 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:02:40,475 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,475 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,475 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,475 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:40,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,475 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,476 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,476 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:40,476 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,475 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,475 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:40,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:40,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-16 16:02:40,476 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:40,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,477 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:02:40,477 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:40,477 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:40,477 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:40,477 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:40,478 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,478 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230916de8df86a3cad420281eb6d31b634564c, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309162c4aecba6eaf46658660e1b6c043ae21] mob files 2023-09-16 16:02:40,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230916de8df86a3cad420281eb6d31b634564c 2023-09-16 16:02:40,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309162c4aecba6eaf46658660e1b6c043ae21 2023-09-16 16:02:40,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-16 16:02:40,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,500 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694880160371Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694880160484 (+113 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694880160484Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694880160484Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694880160487 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694880160493 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694880160499 (+6 ms) 2023-09-16 16:02:40,504 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-16 16:02:40,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 132 msec 2023-09-16 16:02:40,674 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:40,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-16 16:02:40,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:02:40,675 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675 2023-09-16 16:02:40,675 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42433, tgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675, rawTgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675, srcFsUri=hdfs://localhost:42433, srcDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:40,697 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:40,697 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_178486274_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,697 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, snapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-16 16:02:40,702 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:40,717 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:40,717 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:40,717 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:40,718 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,587 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-4428701182443839408.jar 2023-09-16 16:02:41,588 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,588 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-2422509745380697216.jar 2023-09-16 16:02:41,655 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,655 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,656 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,656 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,656 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,656 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:41,657 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-16 16:02:41,657 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-16 16:02:41,658 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-16 16:02:41,658 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-16 16:02:41,658 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-16 16:02:41,659 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-16 16:02:41,659 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-16 16:02:41,659 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-16 16:02:41,660 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-16 16:02:41,660 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-16 16:02:41,661 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:41,661 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:41,661 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:41,662 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:41,662 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:41,662 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:41,663 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:42,012 WARN [Listener at jenkins-hbase4.apache.org/42447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-16 16:02:42,014 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-16 16:02:42,824 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:42,825 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:42,827 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0005_000001 (auth:SIMPLE) 2023-09-16 16:02:43,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0006_000001 (auth:SIMPLE) 2023-09-16 16:02:44,432 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:02:47,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0006_000001 (auth:SIMPLE) 2023-09-16 16:02:50,358 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-16 16:02:50,359 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-16 16:02:50,364 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:50,364 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-16 16:02:50,365 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-16 16:02:50,365 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:50,365 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-16 16:02:50,365 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-16 16:02:50,365 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:50,366 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-16 16:02:50,366 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880160675/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-16 16:02:50,370 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-16 16:02:50,374 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880170374"}]},"ts":"1694880170374"} 2023-09-16 16:02:50,376 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-16 16:02:50,377 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-16 16:02:50,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93390ed0fb171815b1050a3eada639d0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=673ecb948b9e54c2d357374d8f526b8d, UNASSIGN}] 2023-09-16 16:02:50,380 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93390ed0fb171815b1050a3eada639d0, UNASSIGN 2023-09-16 16:02:50,380 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=673ecb948b9e54c2d357374d8f526b8d, UNASSIGN 2023-09-16 16:02:50,381 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=93390ed0fb171815b1050a3eada639d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:50,381 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=673ecb948b9e54c2d357374d8f526b8d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:50,381 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880170381"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880170381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880170381"}]},"ts":"1694880170381"} 2023-09-16 16:02:50,381 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880170381"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880170381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880170381"}]},"ts":"1694880170381"} 2023-09-16 16:02:50,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 93390ed0fb171815b1050a3eada639d0, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:02:50,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 673ecb948b9e54c2d357374d8f526b8d, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:50,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-16 16:02:50,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:50,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:50,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 93390ed0fb171815b1050a3eada639d0, disabling compactions & flushes 2023-09-16 16:02:50,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 673ecb948b9e54c2d357374d8f526b8d, disabling compactions & flushes 2023-09-16 16:02:50,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:50,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:50,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:50,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. after waiting 0 ms 2023-09-16 16:02:50,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:50,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:50,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. after waiting 0 ms 2023-09-16 16:02:50,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:50,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:02:50,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:02:50,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:50,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:02:50,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d. 2023-09-16 16:02:50,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 673ecb948b9e54c2d357374d8f526b8d: 2023-09-16 16:02:50,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0. 2023-09-16 16:02:50,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 93390ed0fb171815b1050a3eada639d0: 2023-09-16 16:02:50,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:50,547 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=93390ed0fb171815b1050a3eada639d0, regionState=CLOSED 2023-09-16 16:02:50,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:50,547 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880170547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880170547"}]},"ts":"1694880170547"} 2023-09-16 16:02:50,547 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=673ecb948b9e54c2d357374d8f526b8d, regionState=CLOSED 2023-09-16 16:02:50,548 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694880170547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880170547"}]},"ts":"1694880170547"} 2023-09-16 16:02:50,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-16 16:02:50,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 93390ed0fb171815b1050a3eada639d0, server=jenkins-hbase4.apache.org,35809,1694880071932 in 166 msec 2023-09-16 16:02:50,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-16 16:02:50,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 673ecb948b9e54c2d357374d8f526b8d, server=jenkins-hbase4.apache.org,45159,1694880071982 in 166 msec 2023-09-16 16:02:50,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93390ed0fb171815b1050a3eada639d0, UNASSIGN in 172 msec 2023-09-16 16:02:50,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-16 16:02:50,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=673ecb948b9e54c2d357374d8f526b8d, UNASSIGN in 173 msec 2023-09-16 16:02:50,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880170552"}]},"ts":"1694880170552"} 2023-09-16 16:02:50,553 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-16 16:02:50,555 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-16 16:02:50,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 185 msec 2023-09-16 16:02:50,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-16 16:02:50,676 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-16 16:02:50,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,680 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,680 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,682 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,685 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:50,685 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:50,685 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,685 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,685 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,685 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-16 16:02:50,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-16 16:02:50,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-16 16:02:50,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-16 16:02:50,687 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/recovered.edits] 2023-09-16 16:02:50,687 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/recovered.edits] 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:50,687 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:50,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-16 16:02:50,691 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf/e695917009844cda9dad5d383932d2fa to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/cf/e695917009844cda9dad5d383932d2fa 2023-09-16 16:02:50,691 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf/d3954313a9aa499f81bab0a969827cf3 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/cf/d3954313a9aa499f81bab0a969827cf3 2023-09-16 16:02:50,693 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d/recovered.edits/9.seqid 2023-09-16 16:02:50,694 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0/recovered.edits/9.seqid 2023-09-16 16:02:50,694 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/673ecb948b9e54c2d357374d8f526b8d 2023-09-16 16:02:50,694 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/93390ed0fb171815b1050a3eada639d0 2023-09-16 16:02:50,694 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-16 16:02:50,694 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-16 16:02:50,695 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-16 16:02:50,698 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230916de8df86a3cad420281eb6d31b634564c to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230916de8df86a3cad420281eb6d31b634564c 2023-09-16 16:02:50,699 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309162c4aecba6eaf46658660e1b6c043ae21 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309162c4aecba6eaf46658660e1b6c043ae21 2023-09-16 16:02:50,699 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-16 16:02:50,701 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,703 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-16 16:02:50,705 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-16 16:02:50,706 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,706 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-16 16:02:50,706 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880170706"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:50,706 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880170706"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:50,708 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-16 16:02:50,708 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 93390ed0fb171815b1050a3eada639d0, NAME => 'testtb-testEmptyExportFileSystemState,,1694880159571.93390ed0fb171815b1050a3eada639d0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 673ecb948b9e54c2d357374d8f526b8d, NAME => 'testtb-testEmptyExportFileSystemState,1,1694880159571.673ecb948b9e54c2d357374d8f526b8d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-16 16:02:50,708 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-16 16:02:50,708 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694880170708"}]},"ts":"9223372036854775807"} 2023-09-16 16:02:50,710 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-16 16:02:50,712 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-16 16:02:50,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 35 msec 2023-09-16 16:02:50,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-16 16:02:50,789 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-16 16:02:50,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-16 16:02:50,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:50,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-16 16:02:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-16 16:02:50,824 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_884124858_1 at /127.0.0.1:38756 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:41313 from appattempt_1694880078471_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1026760493_17 at /127.0.0.1:38776 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4718 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:53056 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:42095 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1900012772_17 at /127.0.0.1:55900 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:39011 from appattempt_1694880078471_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d1938d5-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 128), ProcessCount=168 (was 168), AvailableMemoryMB=7086 (was 7264) 2023-09-16 16:02:50,825 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-16 16:02:50,843 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=168, AvailableMemoryMB=7086 2023-09-16 16:02:50,843 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-16 16:02:50,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-16 16:02:50,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:50,847 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-16 16:02:50,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-16 16:02:50,848 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-16 16:02:50,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-16 16:02:50,850 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:50,850 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:50,851 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13 empty. 2023-09-16 16:02:50,851 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c empty. 2023-09-16 16:02:50,851 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:50,851 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:50,851 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-16 16:02:50,863 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-16 16:02:50,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9a0caac46715ff46d994c139c9112c13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:50,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3c3459fd345e0f24630ce71746d3b42c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp 2023-09-16 16:02:50,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:50,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9a0caac46715ff46d994c139c9112c13, disabling compactions & flushes 2023-09-16 16:02:50,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:50,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:50,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. after waiting 0 ms 2023-09-16 16:02:50,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:50,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:50,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9a0caac46715ff46d994c139c9112c13: 2023-09-16 16:02:50,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-16 16:02:51,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-16 16:02:51,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:51,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 3c3459fd345e0f24630ce71746d3b42c, disabling compactions & flushes 2023-09-16 16:02:51,273 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. after waiting 0 ms 2023-09-16 16:02:51,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,273 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 3c3459fd345e0f24630ce71746d3b42c: 2023-09-16 16:02:51,275 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-16 16:02:51,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880171276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880171276"}]},"ts":"1694880171276"} 2023-09-16 16:02:51,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880171276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880171276"}]},"ts":"1694880171276"} 2023-09-16 16:02:51,278 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-16 16:02:51,278 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-16 16:02:51,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880171278"}]},"ts":"1694880171278"} 2023-09-16 16:02:51,279 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-16 16:02:51,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-16 16:02:51,284 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-16 16:02:51,284 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-16 16:02:51,284 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-16 16:02:51,284 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-16 16:02:51,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3c3459fd345e0f24630ce71746d3b42c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a0caac46715ff46d994c139c9112c13, ASSIGN}] 2023-09-16 16:02:51,287 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a0caac46715ff46d994c139c9112c13, ASSIGN 2023-09-16 16:02:51,287 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3c3459fd345e0f24630ce71746d3b42c, ASSIGN 2023-09-16 16:02:51,287 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a0caac46715ff46d994c139c9112c13, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45159,1694880071982; forceNewPlan=false, retain=false 2023-09-16 16:02:51,287 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3c3459fd345e0f24630ce71746d3b42c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35809,1694880071932; forceNewPlan=false, retain=false 2023-09-16 16:02:51,437 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-16 16:02:51,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3c3459fd345e0f24630ce71746d3b42c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:51,440 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9a0caac46715ff46d994c139c9112c13, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:51,441 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880171440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880171440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880171440"}]},"ts":"1694880171440"} 2023-09-16 16:02:51,441 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880171440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880171440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880171440"}]},"ts":"1694880171440"} 2023-09-16 16:02:51,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 3c3459fd345e0f24630ce71746d3b42c, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:02:51,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9a0caac46715ff46d994c139c9112c13, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:02:51,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-16 16:02:51,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:51,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c3459fd345e0f24630ce71746d3b42c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.', STARTKEY => '', ENDKEY => '1'} 2023-09-16 16:02:51,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a0caac46715ff46d994c139c9112c13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.', STARTKEY => '1', ENDKEY => ''} 2023-09-16 16:02:51,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. service=AccessControlService 2023-09-16 16:02:51,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. service=AccessControlService 2023-09-16 16:02:51,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:51,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-16 16:02:51,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:51,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:51,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:51,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-16 16:02:51,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:51,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:51,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:51,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:51,599 INFO [StoreOpener-3c3459fd345e0f24630ce71746d3b42c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:51,599 INFO [StoreOpener-9a0caac46715ff46d994c139c9112c13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:51,600 DEBUG [StoreOpener-3c3459fd345e0f24630ce71746d3b42c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf 2023-09-16 16:02:51,600 DEBUG [StoreOpener-9a0caac46715ff46d994c139c9112c13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf 2023-09-16 16:02:51,600 DEBUG [StoreOpener-3c3459fd345e0f24630ce71746d3b42c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf 2023-09-16 16:02:51,600 DEBUG [StoreOpener-9a0caac46715ff46d994c139c9112c13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf 2023-09-16 16:02:51,601 INFO [StoreOpener-3c3459fd345e0f24630ce71746d3b42c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c3459fd345e0f24630ce71746d3b42c columnFamilyName cf 2023-09-16 16:02:51,601 INFO [StoreOpener-9a0caac46715ff46d994c139c9112c13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a0caac46715ff46d994c139c9112c13 columnFamilyName cf 2023-09-16 16:02:51,602 INFO [StoreOpener-3c3459fd345e0f24630ce71746d3b42c-1] regionserver.HStore(310): Store=3c3459fd345e0f24630ce71746d3b42c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:51,602 INFO [StoreOpener-9a0caac46715ff46d994c139c9112c13-1] regionserver.HStore(310): Store=9a0caac46715ff46d994c139c9112c13/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-16 16:02:51,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:51,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:51,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:51,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:51,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:02:51,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9a0caac46715ff46d994c139c9112c13 2023-09-16 16:02:51,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:51,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-16 16:02:51,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c3459fd345e0f24630ce71746d3b42c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68753932, jitterRate=0.024513423442840576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:51,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9a0caac46715ff46d994c139c9112c13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69371067, jitterRate=0.03370945155620575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-16 16:02:51,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c3459fd345e0f24630ce71746d3b42c: 2023-09-16 16:02:51,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9a0caac46715ff46d994c139c9112c13: 2023-09-16 16:02:51,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13., pid=109, masterSystemTime=1694880171594 2023-09-16 16:02:51,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c., pid=108, masterSystemTime=1694880171594 2023-09-16 16:02:51,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:51,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:51,610 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9a0caac46715ff46d994c139c9112c13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:51,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,611 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880171610"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880171610"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880171610"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880171610"}]},"ts":"1694880171610"} 2023-09-16 16:02:51,611 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3c3459fd345e0f24630ce71746d3b42c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:51,611 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880171611"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694880171611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694880171611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694880171611"}]},"ts":"1694880171611"} 2023-09-16 16:02:51,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-16 16:02:51,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9a0caac46715ff46d994c139c9112c13, server=jenkins-hbase4.apache.org,45159,1694880071982 in 169 msec 2023-09-16 16:02:51,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-16 16:02:51,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 3c3459fd345e0f24630ce71746d3b42c, server=jenkins-hbase4.apache.org,35809,1694880071932 in 170 msec 2023-09-16 16:02:51,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a0caac46715ff46d994c139c9112c13, ASSIGN in 329 msec 2023-09-16 16:02:51,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-16 16:02:51,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3c3459fd345e0f24630ce71746d3b42c, ASSIGN in 330 msec 2023-09-16 16:02:51,616 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-16 16:02:51,616 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880171616"}]},"ts":"1694880171616"} 2023-09-16 16:02:51,617 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-16 16:02:51,618 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-16 16:02:51,619 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-16 16:02:51,620 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-16 16:02:51,622 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:51,622 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:51,622 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:51,622 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:02:51,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:51,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:51,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:51,625 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-16 16:02:51,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 779 msec 2023-09-16 16:02:51,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-16 16:02:51,952 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-16 16:02:51,954 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:51,954 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:51,956 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:02:51,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-16 16:02:51,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880171968 (current time:1694880171968). 2023-09-16 16:02:51,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:02:51,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x1e924793 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:51,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c5d8b29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:51,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:51,978 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:51,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e924793 to 127.0.0.1:61309 2023-09-16 16:02:51,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:51,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x28f7bfa0 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:51,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2455dbf2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:51,986 DEBUG [hconnection-0x34c10892-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:51,988 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:51,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:51,998 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:51,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28f7bfa0 to 127.0.0.1:61309 2023-09-16 16:02:51,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:51,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-16 16:02:52,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:02:52,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-16 16:02:52,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-16 16:02:52,002 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-16 16:02:52,003 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694880772003 2023-09-16 16:02:52,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-16 16:02:52,004 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:02:52,004 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:02:52,005 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-16 16:02:52,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-16 16:02:52,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-16 16:02:52,007 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-16 16:02:52,008 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694880772008 2023-09-16 16:02:52,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,024 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-16 16:02:52,024 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,026 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-16 16:02:52,026 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-16 16:02:52,034 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,034 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,036 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,036 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,036 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,036 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,036 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,036 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,037 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,037 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-16 16:02:52,038 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,038 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-16 16:02:52,039 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,037 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-16 16:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-16 16:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-16 16:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,039 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-16 16:02:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-16 16:02:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-16 16:02:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-16 16:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-16 16:02:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-16 16:02:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-16 16:02:52,047 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,047 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,047 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:52,047 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,048 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c4d1f1b[Count = 1] remaining members to acquire global barrier 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-16 16:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c4d1f1b[Count = 0] remaining members to acquire global barrier 2023-09-16 16:02:52,051 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-16 16:02:52,051 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,052 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,052 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,052 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-16 16:02:52,053 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:52,053 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,053 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. started... 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-16 16:02:52,053 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,053 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:02:52,053 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:52,053 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c3459fd345e0f24630ce71746d3b42c: 2023-09-16 16:02:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-16 16:02:52,053 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. started... 2023-09-16 16:02:52,054 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:02:52,054 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,054 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:52,055 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:02:52,055 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a0caac46715ff46d994c139c9112c13: 2023-09-16 16:02:52,055 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,055 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:52,055 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-16 16:02:52,056 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-16 16:02:52,056 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,056 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-16 16:02:52,064 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. completed. 2023-09-16 16:02:52,064 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:52,064 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. completed. 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:52,064 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-16 16:02:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:02:52,067 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-16 16:02:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,067 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-16 16:02:52,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-16 16:02:52,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,069 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,069 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-16 16:02:52,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:02:52,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-16 16:02:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:02:52,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-16 16:02:52,078 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-16 16:02:52,078 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:02:52,078 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:02:52,078 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,078 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:02:52,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,080 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,080 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,082 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,083 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,084 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,085 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,085 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,088 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,088 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,089 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:02:52,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,089 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,089 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,090 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,090 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,090 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-16 16:02:52,090 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,105 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:52,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-16 16:02:52,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:02:52,106 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:02:52,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-16 16:02:52,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,120 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694880172003Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694880172102 (+99 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694880172102Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694880172102Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694880172105 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694880172114 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694880172120 (+6 ms) 2023-09-16 16:02:52,123 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-16 16:02:52,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 119 msec 2023-09-16 16:02:52,306 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:52,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-16 16:02:52,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:02:52,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:02:52,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45159] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. with WAL disabled. Data may be lost in the event of a crash. 2023-09-16 16:02:52,312 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,313 DEBUG [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:52,313 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-16 16:02:52,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-16 16:02:52,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694880172321 (current time:1694880172321). 2023-09-16 16:02:52,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-16 16:02:52,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x53611bdf to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:52,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e90cc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:52,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:52,330 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:52,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53611bdf to 127.0.0.1:61309 2023-09-16 16:02:52,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:52,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x315d00e1 to 127.0.0.1:61309 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-16 16:02:52,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a395af6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-16 16:02:52,338 DEBUG [hconnection-0x673bf44b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:52,341 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:52,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-16 16:02:52,346 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-16 16:02:52,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x315d00e1 to 127.0.0.1:61309 2023-09-16 16:02:52,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:02:52,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-16 16:02:52,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-16 16:02:52,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-16 16:02:52,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-16 16:02:52,351 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-16 16:02:52,352 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694880772352 2023-09-16 16:02:52,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-16 16:02:52,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,353 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-16 16:02:52,353 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-16 16:02:52,354 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-16 16:02:52,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-16 16:02:52,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-16 16:02:52,355 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-16 16:02:52,356 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694880772356 2023-09-16 16:02:52,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,366 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-16 16:02:52,366 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,367 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-16 16:02:52,367 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-16 16:02:52,368 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,368 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,370 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,370 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,370 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,370 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,370 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,370 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,371 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,371 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,371 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-16 16:02:52,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-16 16:02:52,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-16 16:02:52,372 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-16 16:02:52,372 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-16 16:02:52,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,372 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,373 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-16 16:02:52,373 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-16 16:02:52,373 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-16 16:02:52,373 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,373 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-16 16:02:52,374 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-16 16:02:52,374 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-16 16:02:52,374 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-16 16:02:52,374 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1694880072020' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-16 16:02:52,374 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,374 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-16 16:02:52,374 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-16 16:02:52,375 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-16 16:02:52,375 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-16 16:02:52,375 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-16 16:02:52,376 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,376 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,376 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,377 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,377 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,377 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,377 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:52,377 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,377 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:52,377 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,377 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-16 16:02:52,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35809,1694880071932' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1871633a[Count = 1] remaining members to acquire global barrier 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45159,1694880071982' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-16 16:02:52,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1871633a[Count = 0] remaining members to acquire global barrier 2023-09-16 16:02:52,380 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-16 16:02:52,380 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,384 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-16 16:02:52,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:52,385 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:52,385 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-16 16:02:52,385 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,385 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-16 16:02:52,385 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42403,1694880072020' in zk 2023-09-16 16:02:52,385 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. started... 2023-09-16 16:02:52,385 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. started... 2023-09-16 16:02:52,385 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3c3459fd345e0f24630ce71746d3b42c 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-16 16:02:52,385 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9a0caac46715ff46d994c139c9112c13 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-16 16:02:52,386 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-16 16:02:52,386 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,387 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1694880072020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-16 16:02:52,401 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230916c55024580d5440a3a4d319e8a3e17498 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230916c55024580d5440a3a4d319e8a3e17498 2023-09-16 16:02:52,401 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309167fdcf4a0407c43998c4af1fc908915dd to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309167fdcf4a0407c43998c4af1fc908915dd 2023-09-16 16:02:52,408 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/.tmp/cf/d6ac1edae5eb4ef993ce871f08269530 2023-09-16 16:02:52,408 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/.tmp/cf/68ea261874ab408f87d7fc0622d5e7ff 2023-09-16 16:02:52,412 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/.tmp/cf/d6ac1edae5eb4ef993ce871f08269530 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf/d6ac1edae5eb4ef993ce871f08269530 2023-09-16 16:02:52,413 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/.tmp/cf/68ea261874ab408f87d7fc0622d5e7ff as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf/68ea261874ab408f87d7fc0622d5e7ff 2023-09-16 16:02:52,417 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf/d6ac1edae5eb4ef993ce871f08269530, entries=44, sequenceid=6, filesize=12.8 K 2023-09-16 16:02:52,417 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf/68ea261874ab408f87d7fc0622d5e7ff, entries=6, sequenceid=6, filesize=6.0 K 2023-09-16 16:02:52,418 INFO [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 3c3459fd345e0f24630ce71746d3b42c in 33ms, sequenceid=6, compaction requested=false 2023-09-16 16:02:52,418 INFO [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 9a0caac46715ff46d994c139c9112c13 in 33ms, sequenceid=6, compaction requested=false 2023-09-16 16:02:52,418 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-16 16:02:52,418 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c3459fd345e0f24630ce71746d3b42c: 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a0caac46715ff46d994c139c9112c13: 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf/68ea261874ab408f87d7fc0622d5e7ff] hfiles 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf/d6ac1edae5eb4ef993ce871f08269530] hfiles 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf/d6ac1edae5eb4ef993ce871f08269530 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf/68ea261874ab408f87d7fc0622d5e7ff for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,429 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. completed. 2023-09-16 16:02:52,429 DEBUG [rs(jenkins-hbase4.apache.org,35809,1694880071932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:02:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-16 16:02:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35809,1694880071932' in zk 2023-09-16 16:02:52,431 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-16 16:02:52,431 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,431 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,431 DEBUG [member: 'jenkins-hbase4.apache.org,35809,1694880071932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-16 16:02:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,434 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. completed. 2023-09-16 16:02:52,434 DEBUG [rs(jenkins-hbase4.apache.org,45159,1694880071982)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:02:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-16 16:02:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-16 16:02:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-16 16:02:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45159,1694880071982' in zk 2023-09-16 16:02:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,435 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,435 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-16 16:02:52,435 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,435 DEBUG [member: 'jenkins-hbase4.apache.org,45159,1694880071982' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-16 16:02:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35809,1694880071932': 2023-09-16 16:02:52,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35809,1694880071932' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-16 16:02:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45159,1694880071982': 2023-09-16 16:02:52,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45159,1694880071982' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-16 16:02:52,441 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-16 16:02:52,441 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-16 16:02:52,442 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-16 16:02:52,442 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,442 INFO [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-16 16:02:52,444 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-16 16:02:52,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-16 16:02:52,444 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,444 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-16 16:02:52,444 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,445 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,445 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-16 16:02:52,447 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,447 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,447 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,450 DEBUG [(jenkins-hbase4.apache.org,42795,1694880070696)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:02:52,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,450 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-16 16:02:52,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,451 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-16 16:02:52,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,451 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,452 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:02:52,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-16 16:02:52,451 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-16 16:02:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-16 16:02:52,452 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:02:52,452 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,452 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-16 16:02:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-16 16:02:52,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309167fdcf4a0407c43998c4af1fc908915dd, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230916c55024580d5440a3a4d319e8a3e17498] mob files 2023-09-16 16:02:52,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309167fdcf4a0407c43998c4af1fc908915dd 2023-09-16 16:02:52,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230916c55024580d5440a3a4d319e8a3e17498 2023-09-16 16:02:52,453 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:52,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-16 16:02:52,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-16 16:02:52,454 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-16 16:02:52,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-16 16:02:52,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,474 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694880172352Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694880172459 (+107 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694880172459Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694880172459Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694880172461 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694880172468 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694880172474 (+6 ms) 2023-09-16 16:02:52,477 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-16 16:02:52,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 124 msec 2023-09-16 16:02:52,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-16 16:02:52,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-16 16:02:52,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-16 16:02:52,655 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655 2023-09-16 16:02:52,655 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42433, tgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655, rawTgtDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655, srcFsUri=hdfs://localhost:42433, srcDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:52,677 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12 2023-09-16 16:02:52,677 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1118842053_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,677 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42433, inputRoot=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12, snapshotDir=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-16 16:02:52,688 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:02:52,702 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:52,702 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:52,702 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:52,703 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,580 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-7112285849340275459.jar 2023-09-16 16:02:53,581 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,581 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,647 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/hadoop-8001570865175487690.jar 2023-09-16 16:02:53,647 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,648 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,648 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,649 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,649 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,650 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-16 16:02:53,650 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-16 16:02:53,651 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-16 16:02:53,651 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-16 16:02:53,651 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-16 16:02:53,652 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-16 16:02:53,652 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-16 16:02:53,652 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-16 16:02:53,653 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-16 16:02:53,653 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-16 16:02:53,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-16 16:02:53,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:53,654 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:53,655 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:53,655 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:53,655 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-16 16:02:53,656 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:53,656 DEBUG [Listener at jenkins-hbase4.apache.org/42447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-16 16:02:53,999 WARN [Listener at jenkins-hbase4.apache.org/42447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-16 16:02:54,001 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-16 16:02:54,003 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-16 16:02:54,547 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:54,547 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-16 16:02:54,554 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0006_000001 (auth:SIMPLE) 2023-09-16 16:02:54,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0007_000001 (auth:SIMPLE) 2023-09-16 16:02:56,151 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:02:58,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0007_000001 (auth:SIMPLE) 2023-09-16 16:03:00,719 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0007_000001 (auth:SIMPLE) 2023-09-16 16:03:03,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694880078471_0007_000001 (auth:SIMPLE) 2023-09-16 16:03:05,170 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-16 16:03:05,171 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-16 16:03:05,182 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,182 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-16 16:03:05,183 INFO [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-16 16:03:05,183 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,183 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-16 16:03:05,183 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-16 16:03:05,183 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1900012772_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,184 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-16 16:03:05,184 DEBUG [Listener at jenkins-hbase4.apache.org/42447] snapshot.TestExportSnapshot(367): hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/export-test/export-1694880172655/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-16 16:03:05,194 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-16 16:03:05,199 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880185199"}]},"ts":"1694880185199"} 2023-09-16 16:03:05,200 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-16 16:03:05,202 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-16 16:03:05,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3c3459fd345e0f24630ce71746d3b42c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a0caac46715ff46d994c139c9112c13, UNASSIGN}] 2023-09-16 16:03:05,205 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a0caac46715ff46d994c139c9112c13, UNASSIGN 2023-09-16 16:03:05,205 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3c3459fd345e0f24630ce71746d3b42c, UNASSIGN 2023-09-16 16:03:05,205 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9a0caac46715ff46d994c139c9112c13, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:03:05,205 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3c3459fd345e0f24630ce71746d3b42c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:03:05,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880185205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880185205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880185205"}]},"ts":"1694880185205"} 2023-09-16 16:03:05,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880185205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694880185205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694880185205"}]},"ts":"1694880185205"} 2023-09-16 16:03:05,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 9a0caac46715ff46d994c139c9112c13, server=jenkins-hbase4.apache.org,45159,1694880071982}] 2023-09-16 16:03:05,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 3c3459fd345e0f24630ce71746d3b42c, server=jenkins-hbase4.apache.org,35809,1694880071932}] 2023-09-16 16:03:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-16 16:03:05,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9a0caac46715ff46d994c139c9112c13 2023-09-16 16:03:05,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9a0caac46715ff46d994c139c9112c13, disabling compactions & flushes 2023-09-16 16:03:05,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:03:05,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:03:05,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. after waiting 0 ms 2023-09-16 16:03:05,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:03:05,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:03:05,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c3459fd345e0f24630ce71746d3b42c, disabling compactions & flushes 2023-09-16 16:03:05,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:03:05,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:03:05,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. after waiting 0 ms 2023-09-16 16:03:05,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:03:05,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:03:05,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:03:05,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:05,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13. 2023-09-16 16:03:05,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9a0caac46715ff46d994c139c9112c13: 2023-09-16 16:03:05,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:05,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c. 2023-09-16 16:03:05,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c3459fd345e0f24630ce71746d3b42c: 2023-09-16 16:03:05,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9a0caac46715ff46d994c139c9112c13 2023-09-16 16:03:05,375 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9a0caac46715ff46d994c139c9112c13, regionState=CLOSED 2023-09-16 16:03:05,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:03:05,375 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880185375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880185375"}]},"ts":"1694880185375"} 2023-09-16 16:03:05,376 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3c3459fd345e0f24630ce71746d3b42c, regionState=CLOSED 2023-09-16 16:03:05,376 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694880185375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694880185375"}]},"ts":"1694880185375"} 2023-09-16 16:03:05,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-16 16:03:05,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 9a0caac46715ff46d994c139c9112c13, server=jenkins-hbase4.apache.org,45159,1694880071982 in 169 msec 2023-09-16 16:03:05,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-16 16:03:05,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 3c3459fd345e0f24630ce71746d3b42c, server=jenkins-hbase4.apache.org,35809,1694880071932 in 170 msec 2023-09-16 16:03:05,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a0caac46715ff46d994c139c9112c13, UNASSIGN in 176 msec 2023-09-16 16:03:05,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-16 16:03:05,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3c3459fd345e0f24630ce71746d3b42c, UNASSIGN in 177 msec 2023-09-16 16:03:05,381 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694880185381"}]},"ts":"1694880185381"} 2023-09-16 16:03:05,382 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-16 16:03:05,383 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-16 16:03:05,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-09-16 16:03:05,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-16 16:03:05,501 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-16 16:03:05,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,504 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,505 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,506 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,509 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:03:05,509 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13 2023-09-16 16:03:05,510 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,510 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,510 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,510 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-16 16:03:05,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-16 16:03:05,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-16 16:03:05,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-16 16:03:05,511 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/recovered.edits] 2023-09-16 16:03:05,511 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf, FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/recovered.edits] 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:03:05,512 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-16 16:03:05,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-16 16:03:05,516 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf/68ea261874ab408f87d7fc0622d5e7ff to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/cf/68ea261874ab408f87d7fc0622d5e7ff 2023-09-16 16:03:05,516 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf/d6ac1edae5eb4ef993ce871f08269530 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/cf/d6ac1edae5eb4ef993ce871f08269530 2023-09-16 16:03:05,518 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c/recovered.edits/9.seqid 2023-09-16 16:03:05,519 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/recovered.edits/9.seqid to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13/recovered.edits/9.seqid 2023-09-16 16:03:05,519 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3c3459fd345e0f24630ce71746d3b42c 2023-09-16 16:03:05,519 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a0caac46715ff46d994c139c9112c13 2023-09-16 16:03:05,519 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-16 16:03:05,520 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-16 16:03:05,520 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-16 16:03:05,524 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309167fdcf4a0407c43998c4af1fc908915dd to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309167fdcf4a0407c43998c4af1fc908915dd 2023-09-16 16:03:05,525 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230916c55024580d5440a3a4d319e8a3e17498 to hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230916c55024580d5440a3a4d319e8a3e17498 2023-09-16 16:03:05,525 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-16 16:03:05,527 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,528 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-16 16:03:05,530 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-16 16:03:05,531 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,531 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-16 16:03:05,531 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880185531"}]},"ts":"9223372036854775807"} 2023-09-16 16:03:05,531 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694880185531"}]},"ts":"9223372036854775807"} 2023-09-16 16:03:05,533 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-16 16:03:05,533 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3c3459fd345e0f24630ce71746d3b42c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694880170844.3c3459fd345e0f24630ce71746d3b42c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9a0caac46715ff46d994c139c9112c13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694880170844.9a0caac46715ff46d994c139c9112c13.', STARTKEY => '1', ENDKEY => ''}] 2023-09-16 16:03:05,533 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-16 16:03:05,533 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694880185533"}]},"ts":"9223372036854775807"} 2023-09-16 16:03:05,534 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-16 16:03:05,536 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-16 16:03:05,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-16 16:03:05,614 INFO [Listener at jenkins-hbase4.apache.org/42447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-16 16:03:05,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-16 16:03:05,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-16 16:03:05,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-16 16:03:05,648 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 764), OpenFileDescriptor=912 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 124) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7003 (was 7086) 2023-09-16 16:03:05,648 WARN [Listener at jenkins-hbase4.apache.org/42447] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-16 16:03:05,648 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-16 16:03:05,658 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-16 16:03:05,768 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694880078471_0007_01_000001 is : 143 2023-09-16 16:03:10,938 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-16 16:03:19,784 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-16 16:03:33,899 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-16 16:03:33,899 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-16 16:03:34,007 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-16 16:03:34,016 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-16 16:03:34,017 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-16 16:03:34,026 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-16 16:03:34,130 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-16 16:03:34,130 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-16 16:03:34,130 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-16 16:03:34,130 INFO [Listener at jenkins-hbase4.apache.org/42447] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-16 16:03:34,130 DEBUG [Listener at jenkins-hbase4.apache.org/42447] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:61309 2023-09-16 16:03:34,130 DEBUG [Listener at jenkins-hbase4.apache.org/42447] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,131 DEBUG [Listener at jenkins-hbase4.apache.org/42447] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-16 16:03:34,131 DEBUG [Listener at jenkins-hbase4.apache.org/42447] util.JVMClusterUtil(257): Found active master hash=1574951451, stopped=false 2023-09-16 16:03:34,131 DEBUG [Listener at jenkins-hbase4.apache.org/42447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:34,131 DEBUG [Listener at jenkins-hbase4.apache.org/42447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-16 16:03:34,131 INFO [Listener at jenkins-hbase4.apache.org/42447] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:03:34,133 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-16 16:03:34,133 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-16 16:03:34,133 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:03:34,133 INFO [Listener at jenkins-hbase4.apache.org/42447] procedure2.ProcedureExecutor(628): Stopping 2023-09-16 16:03:34,133 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-16 16:03:34,133 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-16 16:03:34,133 DEBUG [Listener at jenkins-hbase4.apache.org/42447] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07256ea5 to 127.0.0.1:61309 2023-09-16 16:03:34,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:03:34,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:03:34,133 DEBUG [Listener at jenkins-hbase4.apache.org/42447] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,133 INFO [Listener at jenkins-hbase4.apache.org/42447] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35809,1694880071932' ***** 2023-09-16 16:03:34,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:03:34,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-16 16:03:34,134 DEBUG [Listener at jenkins-hbase4.apache.org/42447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:34,134 INFO [Listener at jenkins-hbase4.apache.org/42447] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-16 16:03:34,134 INFO [Listener at jenkins-hbase4.apache.org/42447] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45159,1694880071982' ***** 2023-09-16 16:03:34,134 DEBUG [Listener at jenkins-hbase4.apache.org/42447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:34,134 INFO [Listener at jenkins-hbase4.apache.org/42447] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-16 16:03:34,134 INFO [RS:0;jenkins-hbase4:35809] regionserver.HeapMemoryManager(220): Stopping 2023-09-16 16:03:34,134 INFO [Listener at jenkins-hbase4.apache.org/42447] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42403,1694880072020' ***** 2023-09-16 16:03:34,134 INFO [RS:1;jenkins-hbase4:45159] regionserver.HeapMemoryManager(220): Stopping 2023-09-16 16:03:34,134 DEBUG [Listener at jenkins-hbase4.apache.org/42447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:34,134 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-16 16:03:34,134 INFO [Listener at jenkins-hbase4.apache.org/42447] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-16 16:03:34,134 INFO [RS:1;jenkins-hbase4:45159] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-16 16:03:34,134 INFO [RS:0;jenkins-hbase4:35809] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-16 16:03:34,135 INFO [RS:1;jenkins-hbase4:45159] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-16 16:03:34,134 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-16 16:03:34,135 INFO [RS:0;jenkins-hbase4:35809] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-16 16:03:34,135 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:03:34,135 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:03:34,135 DEBUG [RS:1;jenkins-hbase4:45159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fc3f1db to 127.0.0.1:61309 2023-09-16 16:03:34,135 INFO [RS:2;jenkins-hbase4:42403] regionserver.HeapMemoryManager(220): Stopping 2023-09-16 16:03:34,135 DEBUG [RS:1;jenkins-hbase4:45159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,135 INFO [RS:2;jenkins-hbase4:42403] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-16 16:03:34,135 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c3c37d8 to 127.0.0.1:61309 2023-09-16 16:03:34,137 INFO [RS:1;jenkins-hbase4:45159] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-16 16:03:34,137 INFO [RS:2;jenkins-hbase4:42403] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-16 16:03:34,135 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-16 16:03:34,138 INFO [RS:1;jenkins-hbase4:45159] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-16 16:03:34,138 INFO [RS:1;jenkins-hbase4:45159] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-16 16:03:34,138 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(3305): Received CLOSE for 34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:03:34,138 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,138 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-16 16:03:34,138 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35809,1694880071932; all regions closed. 2023-09-16 16:03:34,138 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(3305): Received CLOSE for 338a3d38233b332ab5ce8699d85141e7 2023-09-16 16:03:34,138 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:03:34,138 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a1ea2c4 to 127.0.0.1:61309 2023-09-16 16:03:34,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34849c70b7d6d975c8005f0d79ebc879, disabling compactions & flushes 2023-09-16 16:03:34,139 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-16 16:03:34,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:03:34,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-16 16:03:34,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:03:34,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. after waiting 0 ms 2023-09-16 16:03:34,139 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:03:34,140 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-16 16:03:34,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-16 16:03:34,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 34849c70b7d6d975c8005f0d79ebc879 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-16 16:03:34,141 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-16 16:03:34,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-16 16:03:34,141 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1478): Online Regions={34849c70b7d6d975c8005f0d79ebc879=hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879., 338a3d38233b332ab5ce8699d85141e7=hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7.} 2023-09-16 16:03:34,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-16 16:03:34,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-16 16:03:34,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-16 16:03:34,142 DEBUG [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-16 16:03:34,142 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1504): Waiting on 338a3d38233b332ab5ce8699d85141e7, 34849c70b7d6d975c8005f0d79ebc879 2023-09-16 16:03:34,153 DEBUG [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs 2023-09-16 16:03:34,153 INFO [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35809%2C1694880071932:(num 1694880073696) 2023-09-16 16:03:34,153 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,153 INFO [RS:0;jenkins-hbase4:35809] regionserver.LeaseManager(133): Closed leases 2023-09-16 16:03:34,157 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-16 16:03:34,157 INFO [RS:0;jenkins-hbase4:35809] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-16 16:03:34,157 INFO [RS:0;jenkins-hbase4:35809] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-16 16:03:34,157 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-16 16:03:34,157 INFO [RS:0;jenkins-hbase4:35809] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-16 16:03:34,158 INFO [RS:0;jenkins-hbase4:35809] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35809 2023-09-16 16:03:34,165 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:03:34,165 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:03:34,165 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-16 16:03:34,165 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-16 16:03:34,165 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-16 16:03:34,165 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35809,1694880071932 2023-09-16 16:03:34,165 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-16 16:03:34,166 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35809,1694880071932] 2023-09-16 16:03:34,167 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35809,1694880071932; numProcessing=1 2023-09-16 16:03:34,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/.tmp/l/24941b5f5c084cc18fa62ff985ac8c73 2023-09-16 16:03:34,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/.tmp/info/6b1657a35acb4872a648d7fa62b98717 2023-09-16 16:03:34,170 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35809,1694880071932 already deleted, retry=false 2023-09-16 16:03:34,170 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35809,1694880071932 expired; onlineServers=2 2023-09-16 16:03:34,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24941b5f5c084cc18fa62ff985ac8c73 2023-09-16 16:03:34,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b1657a35acb4872a648d7fa62b98717 2023-09-16 16:03:34,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/.tmp/l/24941b5f5c084cc18fa62ff985ac8c73 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/l/24941b5f5c084cc18fa62ff985ac8c73 2023-09-16 16:03:34,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24941b5f5c084cc18fa62ff985ac8c73 2023-09-16 16:03:34,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/l/24941b5f5c084cc18fa62ff985ac8c73, entries=7, sequenceid=18, filesize=5.2 K 2023-09-16 16:03:34,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 34849c70b7d6d975c8005f0d79ebc879 in 37ms, sequenceid=18, compaction requested=false 2023-09-16 16:03:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/acl/34849c70b7d6d975c8005f0d79ebc879/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-16 16:03:34,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/.tmp/rep_barrier/0675d6eadb8e4f30a4a08d64a5e23b06 2023-09-16 16:03:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:34,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:03:34,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34849c70b7d6d975c8005f0d79ebc879: 2023-09-16 16:03:34,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694880074859.34849c70b7d6d975c8005f0d79ebc879. 2023-09-16 16:03:34,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 338a3d38233b332ab5ce8699d85141e7, disabling compactions & flushes 2023-09-16 16:03:34,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:03:34,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:03:34,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. after waiting 0 ms 2023-09-16 16:03:34,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:03:34,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 338a3d38233b332ab5ce8699d85141e7 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-16 16:03:34,193 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0675d6eadb8e4f30a4a08d64a5e23b06 2023-09-16 16:03:34,206 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-16 16:03:34,206 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-16 16:03:34,206 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-16 16:03:34,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/.tmp/info/0189a8bef25d4b54abb07851d2ba93ff 2023-09-16 16:03:34,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/.tmp/table/75c30d0d40524ce38ebe42b5af74537b 2023-09-16 16:03:34,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/.tmp/info/0189a8bef25d4b54abb07851d2ba93ff as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/info/0189a8bef25d4b54abb07851d2ba93ff 2023-09-16 16:03:34,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75c30d0d40524ce38ebe42b5af74537b 2023-09-16 16:03:34,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/.tmp/info/6b1657a35acb4872a648d7fa62b98717 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/info/6b1657a35acb4872a648d7fa62b98717 2023-09-16 16:03:34,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/info/0189a8bef25d4b54abb07851d2ba93ff, entries=2, sequenceid=6, filesize=4.8 K 2023-09-16 16:03:34,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 338a3d38233b332ab5ce8699d85141e7 in 31ms, sequenceid=6, compaction requested=false 2023-09-16 16:03:34,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b1657a35acb4872a648d7fa62b98717 2023-09-16 16:03:34,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/info/6b1657a35acb4872a648d7fa62b98717, entries=48, sequenceid=131, filesize=10.3 K 2023-09-16 16:03:34,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/namespace/338a3d38233b332ab5ce8699d85141e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-16 16:03:34,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/.tmp/rep_barrier/0675d6eadb8e4f30a4a08d64a5e23b06 as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/rep_barrier/0675d6eadb8e4f30a4a08d64a5e23b06 2023-09-16 16:03:34,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:34,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:03:34,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 338a3d38233b332ab5ce8699d85141e7: 2023-09-16 16:03:34,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694880074118.338a3d38233b332ab5ce8699d85141e7. 2023-09-16 16:03:34,233 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0675d6eadb8e4f30a4a08d64a5e23b06 2023-09-16 16:03:34,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/rep_barrier/0675d6eadb8e4f30a4a08d64a5e23b06, entries=13, sequenceid=131, filesize=6.4 K 2023-09-16 16:03:34,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/.tmp/table/75c30d0d40524ce38ebe42b5af74537b as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/table/75c30d0d40524ce38ebe42b5af74537b 2023-09-16 16:03:34,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75c30d0d40524ce38ebe42b5af74537b 2023-09-16 16:03:34,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/table/75c30d0d40524ce38ebe42b5af74537b, entries=24, sequenceid=131, filesize=6.9 K 2023-09-16 16:03:34,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 98ms, sequenceid=131, compaction requested=false 2023-09-16 16:03:34,248 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-16 16:03:34,248 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-16 16:03:34,248 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-16 16:03:34,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-16 16:03:34,249 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-16 16:03:34,249 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-16 16:03:34,268 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,268 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35809,1694880071932; zookeeper connection closed. 2023-09-16 16:03:34,268 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x100b578afc80001, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,269 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5160772e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5160772e 2023-09-16 16:03:34,342 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45159,1694880071982; all regions closed. 2023-09-16 16:03:34,342 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42403,1694880072020; all regions closed. 2023-09-16 16:03:34,349 DEBUG [RS:1;jenkins-hbase4:45159] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs 2023-09-16 16:03:34,349 INFO [RS:1;jenkins-hbase4:45159] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45159%2C1694880071982.meta:.meta(num 1694880073820) 2023-09-16 16:03:34,354 DEBUG [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs 2023-09-16 16:03:34,354 INFO [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42403%2C1694880072020:(num 1694880073696) 2023-09-16 16:03:34,354 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,355 INFO [RS:2;jenkins-hbase4:42403] regionserver.LeaseManager(133): Closed leases 2023-09-16 16:03:34,355 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-16 16:03:34,355 INFO [RS:2;jenkins-hbase4:42403] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-16 16:03:34,355 INFO [RS:2;jenkins-hbase4:42403] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-16 16:03:34,355 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-16 16:03:34,355 INFO [RS:2;jenkins-hbase4:42403] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-16 16:03:34,356 INFO [RS:2;jenkins-hbase4:42403] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42403 2023-09-16 16:03:34,357 DEBUG [RS:1;jenkins-hbase4:45159] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/oldWALs 2023-09-16 16:03:34,357 INFO [RS:1;jenkins-hbase4:45159] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45159%2C1694880071982:(num 1694880073696) 2023-09-16 16:03:34,357 DEBUG [RS:1;jenkins-hbase4:45159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,357 INFO [RS:1;jenkins-hbase4:45159] regionserver.LeaseManager(133): Closed leases 2023-09-16 16:03:34,358 INFO [RS:1;jenkins-hbase4:45159] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-16 16:03:34,358 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-16 16:03:34,358 INFO [RS:1;jenkins-hbase4:45159] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45159 2023-09-16 16:03:34,359 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-16 16:03:34,359 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:03:34,359 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42403,1694880072020 2023-09-16 16:03:34,359 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42403,1694880072020] 2023-09-16 16:03:34,360 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42403,1694880072020; numProcessing=2 2023-09-16 16:03:34,360 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:03:34,360 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45159,1694880071982 2023-09-16 16:03:34,360 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-16 16:03:34,361 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42403,1694880072020 already deleted, retry=false 2023-09-16 16:03:34,361 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42403,1694880072020 expired; onlineServers=1 2023-09-16 16:03:34,362 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45159,1694880071982] 2023-09-16 16:03:34,362 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45159,1694880071982; numProcessing=3 2023-09-16 16:03:34,363 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45159,1694880071982 already deleted, retry=false 2023-09-16 16:03:34,363 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45159,1694880071982 expired; onlineServers=0 2023-09-16 16:03:34,363 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42795,1694880070696' ***** 2023-09-16 16:03:34,363 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-16 16:03:34,363 DEBUG [M:0;jenkins-hbase4:42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce2d020, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-16 16:03:34,364 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42795,1694880070696 2023-09-16 16:03:34,364 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42795,1694880070696; all regions closed. 2023-09-16 16:03:34,364 DEBUG [M:0;jenkins-hbase4:42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-16 16:03:34,364 DEBUG [M:0;jenkins-hbase4:42795] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-16 16:03:34,364 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-16 16:03:34,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694880073315] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694880073315,5,FailOnTimeoutGroup] 2023-09-16 16:03:34,364 DEBUG [M:0;jenkins-hbase4:42795] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-16 16:03:34,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694880073315] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694880073315,5,FailOnTimeoutGroup] 2023-09-16 16:03:34,364 INFO [M:0;jenkins-hbase4:42795] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-16 16:03:34,364 INFO [M:0;jenkins-hbase4:42795] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-16 16:03:34,364 INFO [M:0;jenkins-hbase4:42795] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-16 16:03:34,364 DEBUG [M:0;jenkins-hbase4:42795] master.HMaster(1512): Stopping service threads 2023-09-16 16:03:34,364 INFO [M:0;jenkins-hbase4:42795] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-16 16:03:34,365 ERROR [M:0;jenkins-hbase4:42795] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-09-16 16:03:34,365 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-16 16:03:34,365 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-16 16:03:34,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-16 16:03:34,365 INFO [M:0;jenkins-hbase4:42795] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-16 16:03:34,365 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-16 16:03:34,366 DEBUG [M:0;jenkins-hbase4:42795] zookeeper.ZKUtil(398): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-16 16:03:34,366 WARN [M:0;jenkins-hbase4:42795] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-16 16:03:34,366 INFO [M:0;jenkins-hbase4:42795] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-16 16:03:34,366 INFO [M:0;jenkins-hbase4:42795] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-16 16:03:34,367 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-16 16:03:34,367 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:03:34,367 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:03:34,367 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-16 16:03:34,367 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:03:34,367 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.12 KB 2023-09-16 16:03:34,380 INFO [M:0;jenkins-hbase4:42795] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/45371dd4f93649de8b3687f3ba84469d 2023-09-16 16:03:34,384 INFO [M:0;jenkins-hbase4:42795] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45371dd4f93649de8b3687f3ba84469d 2023-09-16 16:03:34,385 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/45371dd4f93649de8b3687f3ba84469d as hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/45371dd4f93649de8b3687f3ba84469d 2023-09-16 16:03:34,389 INFO [M:0;jenkins-hbase4:42795] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45371dd4f93649de8b3687f3ba84469d 2023-09-16 16:03:34,389 INFO [M:0;jenkins-hbase4:42795] regionserver.HStore(1080): Added hdfs://localhost:42433/user/jenkins/test-data/fa003720-3a5c-ee8f-560c-38a1cd0e1b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/45371dd4f93649de8b3687f3ba84469d, entries=119, sequenceid=899, filesize=28.7 K 2023-09-16 16:03:34,390 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384932, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-16 16:03:34,391 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-16 16:03:34,391 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-16 16:03:34,395 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-16 16:03:34,395 INFO [M:0;jenkins-hbase4:42795] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-16 16:03:34,396 INFO [M:0;jenkins-hbase4:42795] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42795 2023-09-16 16:03:34,397 DEBUG [M:0;jenkins-hbase4:42795] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42795,1694880070696 already deleted, retry=false 2023-09-16 16:03:34,461 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,461 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42403,1694880072020; zookeeper connection closed. 2023-09-16 16:03:34,461 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x100b578afc80003, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,461 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b3925ac] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b3925ac 2023-09-16 16:03:34,561 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,561 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42795,1694880070696; zookeeper connection closed. 2023-09-16 16:03:34,561 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100b578afc80000, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,661 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,662 DEBUG [Listener at localhost/36395-EventThread] zookeeper.ZKWatcher(600): regionserver:45159-0x100b578afc80002, quorum=127.0.0.1:61309, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-16 16:03:34,662 INFO [RS:1;jenkins-hbase4:45159] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45159,1694880071982; zookeeper connection closed. 2023-09-16 16:03:34,662 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e52f3fa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e52f3fa 2023-09-16 16:03:34,662 INFO [Listener at jenkins-hbase4.apache.org/42447] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-16 16:03:34,662 WARN [Listener at jenkins-hbase4.apache.org/42447] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-16 16:03:34,665 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-16 16:03:34,769 WARN [BP-617130484-172.31.14.131-1694880066845 heartbeating to localhost/127.0.0.1:42433] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-16 16:03:34,769 WARN [BP-617130484-172.31.14.131-1694880066845 heartbeating to localhost/127.0.0.1:42433] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-617130484-172.31.14.131-1694880066845 (Datanode Uuid b83353fc-5ccd-4bcd-ab27-6ba958804917) service to localhost/127.0.0.1:42433 2023-09-16 16:03:34,771 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data5/current/BP-617130484-172.31.14.131-1694880066845] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-16 16:03:34,772 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data6/current/BP-617130484-172.31.14.131-1694880066845] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-16 16:03:34,773 WARN [Listener at jenkins-hbase4.apache.org/42447] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-16 16:03:34,775 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-16 16:03:34,878 WARN [BP-617130484-172.31.14.131-1694880066845 heartbeating to localhost/127.0.0.1:42433] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-16 16:03:34,878 WARN [BP-617130484-172.31.14.131-1694880066845 heartbeating to localhost/127.0.0.1:42433] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-617130484-172.31.14.131-1694880066845 (Datanode Uuid 5351cc32-90ab-47fc-953c-caa254796032) service to localhost/127.0.0.1:42433 2023-09-16 16:03:34,879 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data3/current/BP-617130484-172.31.14.131-1694880066845] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-16 16:03:34,880 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data4/current/BP-617130484-172.31.14.131-1694880066845] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-16 16:03:34,881 WARN [Listener at jenkins-hbase4.apache.org/42447] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-16 16:03:34,883 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-16 16:03:34,986 WARN [BP-617130484-172.31.14.131-1694880066845 heartbeating to localhost/127.0.0.1:42433] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-16 16:03:34,986 WARN [BP-617130484-172.31.14.131-1694880066845 heartbeating to localhost/127.0.0.1:42433] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-617130484-172.31.14.131-1694880066845 (Datanode Uuid 1a5c4b32-c07b-4178-b74f-e2f3202b06d1) service to localhost/127.0.0.1:42433 2023-09-16 16:03:34,986 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data1/current/BP-617130484-172.31.14.131-1694880066845] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-16 16:03:34,987 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e0e840-92a8-1e79-f181-0e42c8d4cb31/cluster_04ddb447-cec2-a4c4-2f54-b4b7033c1230/dfs/data/data2/current/BP-617130484-172.31.14.131-1694880066845] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-16 16:03:35,009 INFO [Listener at jenkins-hbase4.apache.org/42447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-16 16:03:35,135 INFO [Listener at jenkins-hbase4.apache.org/42447] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-16 16:03:35,232 INFO [Listener at jenkins-hbase4.apache.org/42447] hbase.HBaseTestingUtility(1293): Minicluster is down